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ABSTRACT 


This work presents a novel nature-inspired metaheuristic called Nutcracker Optimization Algorithm 
(NOA) inspired by Clark’s nutcrackers. The nutcrackers exhibit two distinct behaviors that occur at 
separate periods. The first behavior, which occurs during the summer and fall seasons, represents the 
nutcracker’s search for seeds and subsequent storage in an appropriate cache. During the winter and 
spring seasons, another behavior based on the spatial memory strategy is regarded to search for the 
hidden caches marked at different angles using various objects or markers as reference points. If the 
nutcrackers cannot find the stored seeds, they will randomly explore the search space to find their 
food. NOA is herein proposed to mimic these various behaviors to present a new, robust metaheuristic 
algorithm with different local and global search operators, allowing it to solve various optimization 
problems with better outcomes. NOA is evaluated on twenty-three standard test functions, test suites 
of CEC-2014, CEC-2017, and CEC-2020 and five real-world engineering design problems. NOA is 
compared with three classes of existing optimization algorithms: (1) SMA, GBO, EO, RUN, AVOA, RFO, 
and GTO as recently-published algorithms, (2) SSA, WOA, and GWO as highly-cited algorithms, and 
(3) AL-SHADE, L-SHADE, LSHADE-cnEpSin, and LSHADE-SPACMA as highly-performing optimizers and 
winners of CEC competition. NOA was ranked first among all methods and demonstrated superior 
results when compared to LSHADE-cnEpSin and LSHADE-SPACMA as the best-performing optimizers 
and the winners of CEC-2017, and AL-SHADE and L-SHADE as the winners of CEC-2014. 

Published by Elsevier B.V. 


1. Introduction 


these approaches to dynamic routing problems. These algorithms 
also show efficiency in sequential data processing in medical 


During the past two decades, meta-heuristic (MH) algorithms 
have stirred great interest in the evolutionary computation com- 
munity. This interest is due to the high precision, optimization 
speed, and low computational complexity of these algorithms. 
MH approaches have proven to be highly capable of solving 
complex optimization problems in various applied disciplines. 
Chamaani et al. [31] presented the application of these methods 
in the optimization of time and frequency domains for antennas. 
Penghui et al. [32] discussed the application of MH approaches 
in the development of a hybrid artificial intelligence model for 
soil temperature prediction. Gao et al. [33] proposed applying 
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applications, which is highly valuable for various gene model- 
ing activities [34]. Furthermore, protein structure modeling and 
assignments can be solved by using specific derivatives of MH 
methods, as discussed in [35]. Analysis of the medical results can 
also depend on MH methods. In the field of medical diagnosis, 
the customized version of the MH approach has shown excellent 
results in analyzing medical data for classification [36,37] and ra- 
diotherapy planning [38]. Recently, MH approaches are reported 
to support text mining in real-time applications [39] and spectral 
clustering [21]. These methods in protein encoding are reported 
in medical applications [40]. In physical applications, many MH 
approaches have been devoted to extracting parameters of differ- 
ent photovoltaic models [41-45]. MH methods were also used in 
engineering for a variety of purposes. Mirghasemi et al. [46] used 
these methods to reduce image noise. Zhang et al. [47] offered 
particle filtering for robot localization. Das et al. [48] provided 
a detailed examination of these methods, including recent ad- 
vancements, a range of conceivable applications, and theoretical 
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Table 1 

A summary of Nature-Inspired Algorithms, for which the behavior of animals or plants was an inspiration for the optimization 

technique. 
Method Ref. Inspiration from nature Year 
Particle Swarm Optimization (PSO) 1 Flock of fish, birds, etc. 1995 
Ant Colony Optimization (ACO) 2 Ants in a colony 1999 
Marriage in Honey Bees Optimization (MPO) 3 Honey bees 2001 
Artificial Fish Swarm Algorithm (AFSA) 4 Fish swarm 2003 
Termite Algorithm (TA) 5 Termites in a colony 2006 
Artificial Bee Colony (ABC) 6 Bees in a colony 2007 
Cuckoo Search Algorithm(CS) 7 Cuckoos 2009 
Firefly algorithm (FA) 8 Fireflies 2010 
Bat-Inspired Algorithm (BA) 9 Bats 2010 
Flower Pollination Algorithm 10 Flower pollination 2012 
Krill Herd (KH) it Krill 2012 
Bird Mating Optimizer (BMO) 12 Birds 2013 
Spider Monkey Optimization algorithm (SMO) pe} Spider Monkey 2014 
Gray Wolf Optimizer (GWO) 14 Pack of wolves 2014 
Ant Lion Optimizer (ALO) 15 Ant lions 2015 
Crow search algorithm (CSA) 16 Crows 2016 
Whale Optimization Algorithm (WOA) iF Whale 2016 
Salp Swarm Algorithm (SSA) 18 Salp 2017 
Satin bowerbird optimizer (SBO) 19 bower bird 2017 
Emperor penguin optimize (EPO) 20 Emperor penguin 2018 
Squirrel Search Algorithm (SSA) 21 Squirrels 2018 
Harris Hawks Optimization (HHO) 22 Hawks 2019 
Seagull optimization algorithm (SOA) 23 Seagull 2019 
Slime Mould Algorithm (SMA) 24 Mould 2020 
Chimp optimization algorithm 25 Chimp 2020 
Red fox optimization algorithm (RFO) 26 Red fox 2021 
Artificial gorilla troops optimizer (GTO) a7 Gorilla 2021 
Aquila Optimizer (AO) 28 Aquila 2021 
Carnivorous plant algorithm (CPA) 29 Carnivorous plant 2021 
Artificial hummingbird algorithm (AHA) 30 Hummingbirds 2022 


foundations. MH approaches are expected to be greatly utilized 
in different areas of life due to their high accuracy and ease of 
implementation. 

Nature is the source of inspiration for most MH methods. 
We can see amazing ways animals hunt, reproduce, or travel 
in search of food. We can also see exciting phenomena in the 
plant world and natural elements that inspire the development of 
science. These behaviors have recently been modeled in a variety 
of optimization techniques, the results of which are summarized 
in Table 1. 

Among the state-of-the-art MH algorithms, we have many 
well-known classic models, such as simulated annealing, pro- 
posed in [49], where the concept of burning iron and other 
metals was used to construct one of the earliest optimization 
techniques. The genetic algorithm (GA), which is presented in 
Ref. [50], is one of the most popular optimization algorithms that 
simulate the evolution of genes. The GA comprises different types 
of randomness. This algorithm randomly performs selection, re- 
production, mutation, and other operations, which greatly helps 
in avoiding local optima. Random behavior is the main feature 
of optimization algorithms, which leads to non-deterministic re- 
sults. The idea of human imitation of nature is successful because 
the development of a model of interaction and communication 
of life between individual animals is selected as a strategy for 
improvement. Particle swarm optimization, which is presented 
in [1], is the first and most popular among these algorithms. 
Differentiable evolution, which was proposed in [51], is inspired 
by the concept of the natural phenomenon of evolution. The ant 
colony optimization proposed in [2] is inspired by the behavior 
of ants in foraging. The artificial bee colony presented in [6] 
simulates the behavior of bees in foraging and the production 
of honey. The cuckoo search algorithm proposed in [7] simulates 
the behavior of cuckoo breeding parasitism. Ref. [9] presented a 
simulation of the echolocation abilities of bats, wherein a cus- 
tom echolocation-based locomotion model was proposed in Bat 
Algorithm (BA). Ref. [10] proposed a flower pollination algorithm, 


which is inspired by the pollination process of flowers. Ref. [15] 
presented an ant lion optimizer, which simulates the manner 
the ant lion ambushes to search in the solution space for the 
optimal point. The salp swarm algorithm (SSA) presented in [18] 
simulates the swarming behavior of salps when navigating and 
foraging in oceans. Many other optimization algorithms based 
on certain characteristics of animal life, such as unique hunt- 
ing method, migratory method in search of food or breeding, 
and other lifestyles, have been proposed in recent years. The 
seagull optimization algorithm presented in [23] simulates the 
migration behaviors of a seagull in nature. Ref. [24] proposed the 
slime mould algorithm, which simulates the oscillation style of 
slime mould in nature. Ref. [26] presented a red fox optimization 
algorithm, which simulates the strange shapes of the red fox 
during a hunt because it uses different strategies to distract the 
prey, approach it, and then pounce on it. The carnivorous plant 
algorithm presented in [29] is one of the recently introduced 
optimization algorithms that simulates how carnivores hunt to 
survive in a harsh environment. The latest algorithm is inspired 
by hummingbirds, which mimics hummingbirds’ skills in flight 
and the intelligent strategy of these birds in foraging [30]. The 
chimp optimization algorithm (ChOA) is improved in [52] to 
help search agents make the transition from exploratory to ex- 
ploitative mode. Furthermore, in [53], the niching technique is 
integrated with the ChOA to prevent premature convergence by 
preserving the chimp’s diversity during the optimization process. 
Ref. [54] presented a new variant of the gray wolf optimizer, 
dubbed the cross-dimensional coordination gray wolf optimizer 
(CDCGWO), which employs a novel learning technique to pre- 
serve the wolf's diversity for avoiding premature convergence in 
multimodal optimization tasks. 

MH methods are called stochastic methods. As the name of 
these techniques suggests, they initially randomly perform op- 
timization. The optimization process begins by creating a set of 
random solutions. These initial solutions are combined, trans- 
formed, or developed via iterations or generations through a 
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predetermined number of steps. These methods are different 
from each other because they use distinct ways to combine, 
transfer, or develop solutions during improvement. 

MH methods have become a powerful alternative to deter- 
ministic methods for solving various optimization problems. Al- 
though deterministic methods are effective in solving problems 
involving linear (unimodal) search spaces, they tend to get stuck 
at local optima when applied to nonlinear search space problems, 
including non-convex real-world problems [55]. Moreover, deter- 
ministic algorithms require derivative information and mechani- 
cally and iteratively work without any randomness. By contrast, 
MH methods do not need derived information and work within 
a random nature that allows them to search for all optimal 
solutions in the search space while avoiding local optima. MH 
optimization methods have two key features: (1) exploration and 
(2) exploitation. Exploration is the ability to search space globally. 
This ability is linked to escaping local optima and preventing 
stagnation in the same. Meanwhile, exploitation is the ability to 
locally explore promising regions to improve their quality. A good 
compromise between these two properties results in optimal 
performance. These properties are used by all population-based 
algorithms, but with various operators and processes. 

Despite the success of traditional and modern algorithms, no 
algorithm guarantees to find the global optimal solution for all 
optimization problems. This notion is logically proven by “No 
Free-lunch” [56] theory. Accordingly, researchers are motivated 
to design new and more efficient algorithms. In this article, we 
present a new optimization algorithm inspired by the behavior 
of the nutcracker in the search for good quality food and its be- 
havior in the storage of food. This work also presents the unique 
behavior of birds in search of stored food again and retrieve it. The 
strange and unique behavior of the aforementioned nutcracker 
prompted researchers to design a new optimization algorithm 
model, which proved effective in solving various optimization 
problems. 

The remainder of this paper is structured as follows: Sec- 
tion 2 presents a brief overview of Cark’s nutcrackers in nature. 
Section 3 details our proposed NOA. Section 4 outlines the imple- 
mentation method for the proposed algorithm. Section 5 presents 
the optimization outcomes and analyses for many test mathemat- 
ical problems. Some real-world optimization problems and their 
outcome are presented in Section 6. Finally, Section 7 provides 
the conclusion and future work. 


2. Cark’s nutcrackers in nature 


Clark’s nutcrackers, Nucifraga columbiana, are a high latitude 
resident corvid species (Family Corvidae) that live in the moun- 
tain regions of the western USA and Canada [57,58]. Like other 
species of the Corvidae family, Clark’s nutcrackers are distin- 
guished by their extraordinary intelligence. Clark’s nutcrackers 
are pale gray birds with black wings (see Fig. 1). These birds often 
live alone, unlike other species of the Corvidae family that live in 
family groups, such as crows. The popularity of these birds stems 
from the positive relationship that they have with pine trees. 
Pine seeds are the primary food source for Clark’s nutcrackers. 
Meanwhile, Clark’s nutcracker is the primary seed disperser of 
whitebark pine (Pinus albicaulis) [59,60]. Several studies have 
shown that the declining white pine numbers negatively affect 
nutcracker numbers [61-64]. 

Clark’s nutcrackers (hereafter referred to as the “nutcracker”) 
are regarded as one of the most specialized scatter-hoarding birds 
and are an effective distributor of whitebark pine seeds [65]. 
The nutcracker’s unique method of transporting and storing pine 
seeds is unique. A single nutcracker caches about 22,000 to 
33,000 pine seeds, distributed over thousands of separate po- 
sitions in autumn with a good seed crop [58,66]. Nutcrackers 
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Fig. 1. Nutcracker bird. 


are dependent on stored seeds in winter, which they can extract 
even through the deep snow cover. Caching continues until the 
seed crop is depleted or inclement weather intervenes. More- 
over, nutcrackers collect seeds from trees with high efficiency. 
Nutcrackers can also distinguish between edible and aborted 
seeds; they can select cones that have an above-average number 
of good seeds and seem to concentrate on trees that produce 
cones with many good seeds. A pinecone is an organ of the pine 
tree containing its reproductive structures (seeds). The nutcracker 
has a sublingual bag that can carry up to 90 pinon pine seeds per 
trip [67-69]. The seeds can be transported up to 32 km from the 
collection area (pine trees) to temporary storage positions where 
they are buried in groups (usually 4-5 pine seeds) in underground 
caches at a depth of 2-3 cm [67,70-73]. The seeds are buried 
on treeless uplands and on south-facing slopes where the snow 
melts earliest in the spring [74,75]. 

Nutcrackers choose high-quality pine seeds because they are 
large and easily harvested [75]. Additionally, nutcrackers prefer 
locally abundant trees because they collect seeds from cones on 
the tree with a higher cone density [76,77]. Nutcrackers also 
choose viable seeds, which reflect positively on the pine trees 
because these increase their chances of reproduction. Moreover, 
nutcrackers store considerable seeds in temporary storage, re- 
ducing competition for moisture and space [72,78]. The depth 
at which the seeds are stored is compatible with germination 
requirements, and many positions selected appear suitable for 
seed germination [61,64,78,79]. 

The nutcracker uses spatial memory to retrieve food stored in 
the field [80]. Several studies show that nutcrackers can remem- 
ber storage locations for up to 9 months [80-82]. Nutcrackers 
use visual cues to recall the exact position of each cache [83- 
85]. Researchers in this field have found that nutcrackers use 
two or more objects as cues [58,83,86]. When a nutcracker digs 
its hole, it will see two or three things attached to the site: 
an uneven rock, a bush, the trunk of a tree, and so on. Studies 
show that nutcrackers can remember up to 80% of buried stores. 
However, nutcrackers sometimes do not get their food inside 
the storage for various reasons; either the storage was stolen 
by another nutcracker/bird, or it was destroyed due to nature or 
other unknown factors. 

In this work, a novel nature-inspired MH algorithm was intro- 
duced based on the search, cache, and recovery behaviors of the 
nutcracker. In the next section, these behaviors are mathemati- 
cally modeled and a nutcracker optimization algorithm (NOA) is 
proposed. 


3. Nutcracker optimization algorithm (NOA) 


A bio-inspired optimization algorithm (NOA) based on the 
nutcracker’s intelligent behaviors is presented in this section. 
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Fig. 2. Search space in NOA. 


As previously mentioned, the behavior of the nutcracker can be 
divided into two main parts: the first one is to collect pine seeds 
(food) and store them; and the second one is to search for and 
retrieve storage places. These two behaviors are characterized 
by their occurrence in two different periods. The first behavior 
occurs in the summer and fall periods. Meanwhile, the second 
behavior occurs in the winter and spring periods. In the proposed 
algorithm, we simulate the behavior of a nutcracker based on 
the aforementioned two main behaviors. The two main strategies 
are (i) foraging and storage strategy; and (ii) cache-search and 
recovery strategy. These strategies can be explained as follows. 


3.1. Foraging and storage strategy 


Nutcrackers start randomly searching for pine seeds (a food 
source) in the pine forest. Hereinafter, we will call the pine forests 
a collection area. Nutcrackers select pine cones that contain good 
seeds. If nutcrackers do not find the desired seed in the selected 
pine tree, then they will explore good seeds in other pine trees 
in the collection area. This behavior is called the first explo- 
ration phase. Then, nutcrackers exploit the abundance of seeds 
and store them away from the collection area. They transport 
the forage to suitable storage sites, usually high areas without 
heavy afforestation, as shown in Fig. 2. Low and wooded sites 
are vulnerable to poaching or damage by rodents and birds, in 
addition to other weather-related reasons. This behavior is called 
the first exploitation phase. 


3.2. Cache-search and recovery strategy 


During winter, nutcrackers begin to explore the stored seeds. 
This behavior is called the second exploration phase. Nutcrackers 
do not only randomly search for their caches but also use objects 
near the caches as clues to determine their location. Furthermore, 
nutcrackers use spatial memory as the main mechanism to help 
recover their caches. They use multiple objects near a single cache 
and have the ability to remember the location of the cache for a 
long time. Nutcrackers exploit food caches to feed themselves and 
their young for up to 6 months. This behavior is called the second 
exploitation phase. Nutcrackers rely more on spatial memory to 
survive. However, nutcrackers cannot sometimes find the cache, 
so they seek another cache to recover their food. 

In reality, both of the two types behaviors discussed above 
occur at two distinct times: nutcrackers store pine seeds in late 
summer and fall every year and buried seeds, which will serve as 
their main food source, during winter and spring. All the above- 
mentioned nutcrackers’ behaviors will be mathematically simu- 
lated to propose a novel MH approach for solving optimization 
problems. 


3.3. Framework of the proposed NOA 


The overall goal of this work is to present a new optimization 
method that mimics the behavior of nutcrackers in foraging, 
storing, and recovering pine seeds. The following principles de- 
rived from this behavior achieve the basic assumptions of this 
algorithm: 


e A nutcracker lives in individual form. 


e A nutcracker has two behaviors in two separate periods. 

e Anutcracker seeks efficient pine seeds in the collection area. 

e A nutcracker carries pine seeds to places far from the col- 
lection area and buries them. 

e A nutcracker memorizes the location of the buried seeds. 


In reality, nutcrackers can have multiple caches. However, we 
assume that each nutcracker only has one food source, one 
cache, for simplicity. Specifically, a solution X; is equivalent to 
a nutcracker and/or a food source. In future studies, we can 
easily extend to multiple caches for each nutcracker and multiple 
nutcrackers for multi-objective optimization problems. 

Fig. 3 illustrates the framework of the proposed NOA. NOA 
has a very simple structure consisting of two main strategies 
representing two different behaviors that occurred during two 
separate periods. The first strategy represents the nutcracker’s 
behavior in searching for forage and then storing it in an ap- 
propriate cache. By contrast, the second strategy represents the 
behavior of the nutcracker in searching for and retrieving stored 
places. In NOA, the search space can be divided into two areas: 
the first one is the collection area, which means the area from 
which the nutcracker collects its food; the second one is a storage 
area, which means the area in which the nutcracker stores its 
food. The proposed information-sharing mechanism between the 
two strategies in NOA is also shown in Fig. 3, where each strategy 
consists of local exploitation and global exploration. In summary, 
this figure depicts the behavior of nutcrackers mimicked by NOA 
in order to present a novel metaheuristic algorithm capable of 
tackling a variety of optimization problems. At the start of the op- 
timization process, a group of the nutcrackers will go to explore 
the search space for finding their food, represented in the pine 
seeds. The discovered pine seeds will be stored in the appropriate 
caches to be retrieved through the winter and spring seasons 
until the nutcrackers reproduce and survive. The first mechanism 
followed by the nutcrackers through the summer and fall periods 
is defined as the foraging and storage strategy, which employs 
an exploration operator as the first stage to explore the search 
space for finding the most promising regions, which include the 
pine seeds. Following that stage, the exploitation operator will be 
fired to store the discovered pine seeds in an appropriate cache 
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Fig. 3. The framework of the proposed NOA. 


marked with various objects or markers as a cue to help them 
find them through the winter and spring seasons. Through the 
winter and spring seasons, a different mechanism based on the 
spatial memory strategy is followed by the nutcracker to search 
for and retrieve the stored pine seeds. This mechanism is referred 
to as the cache-search and recovery strategy. In this strategy, 
an exploration operator based on the reference points that mark 
the hiding places of caches is employed to explore the regions 
around those reference points to find the hidden caches. When 
finding the hidden caches, the exploitation operator will be fired 
to retrieve the buried pine seeds. The detailed explanation for 
these two strategies is presented within the next sections. 


3.3.1, Foraging and storage strategy 

The above-mentioned mechanism can be divided into two 
main stages, namely, foraging and storage, which are described 
as follows: 


e Foraging stage: Exploration phase 1 


At this stage, the nutcrackers begin to take their initial posi- 
tions/food positions, generated by Eq. (19), in the search space 
(collection area). Each nutcracker begins by checking the cone 
that contains the seeds in the initial position. If the nutcracker 
finds good seeds, then it will take them to the storage area to bury 
them in a cache. If the nutcracker cannot find good seeds, then it 
will seek another cone in another position within pine trees or 
other trees. This behavior can be mathematically modeled using 
the position update strategy as follows: 


Xi; if TT] <T2 
Xinj ye (Xa, Xp) 
a +h. (r’.U;—4), if t < Tinax/2.0 
; ; ; : other wise 
Xcite: (Xa, = Xp) 
+p. (r1 < 8). (r?.U; — Lj) , Otherwise 


(1) 


where X/*" is the new position of the ith nutcracker in the current 
generation ¢; Xi is the jth position of the ith nutcracker in the 
current generation; U; and L; are vectors, including the upper and 
lower bound of the jth dimension in the optimization problem; y 
is a random number generated according to the levy flight; Xj... ; 
is the jth dimension of the best solution obtained even now; A, 


C, and B are three different indices randomly selected from the 
population to facilitate exploration of a high-quality food source; 
T, T2,, and r; are random real numbers in the range of [0,1]; Xini 
is the mean of the jth dimensions of all solutions of the current 
population in the iteration t; and jz is a number generated based 
on the normal distribution (t4), levy-flight (75), and randomly 
between zero and one (73) as shown in the following equation: 


T3 if Tt <1 
if T2 <13 (2) 


Ts if ry < 13 


w= yt 


where r2 and r3 are random real numbers in the range of [0,1]. 
Eq. (1) was suggested to investigate high-quality food sources. 
The first state of Eq. (1) simulates the probability that the 
nutcrackers discover good seeds on the first try. This notion 
means that the nutcrackers will not change their original jth 
dimension in the solution X/. The second state of Eq. (1) was 
proposed to allow the nutcrackers to globally explore random 
positions in the search space to enhance the search capability of 
NOA for exploring the search space as must as possible to avoid 
being stuck into local minima and reaching the promising regions 
that might include the near-optimal solution. The third state of 
Eq. (1) was proposed to allow the nutcrackers to explore positions 
around a solution randomly selected from the population in 
addition to moving globally in the search space with a probability 
6 to cover intractable regions by the second state of Eq. (1). The 
sensitivity analysis for estimating the best value for 6 is intro- 
duced later. A and B were suggested to provide the nutcrackers 
with information about the new food position. t; and t2 were 
suggested as scaling factors to manage the exploration ability in 
NOA. The proposed algorithm can alternate between local and 
global searches with a range of small and large values for 7, 
and tT). « provides nutcracker information about the required 
direction with various step sizes to explore a new position. This 
exploration phase is depicted in Fig. 4(a) for four independent 
runs to show how far it is capable of exploring the regions 
within the search space. From this figure, it is clear that most 
of the search space is coverage by the solutions generated under 
the foraging stage through the whole optimization process to 
affirm that this stage is as effective as approved in the practical 
experiments conducted later. 
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e Storage stage: Exploitation phase 1 


Nutcrackers begin by transporting the food obtained in the 
previous phase, exploration phase 1, to temporary storage loca- 
tions (storage area). This stage is known as “exploitation phase 
1”, where the nutcrackers exploit pine seed crops and store them. 
Such behavior can be mathematically expressed as follows: 


x +L: (Kes — x1) -[Al+ry.- (Xi —x}) if t) <t 


cee = cam +p: (X5 - xs) if t%] <3 
xl Other wise 

(3) 

where yale is a new position in the storage area of the 


nutcrackers in current iteration t, A is anumber generated accord- 
ing to the lévy flight, and t3 is a random number between 0 and 
1. 1 is a factor that linearly decreased from 1 to 0 to diversify in 
the exploitation behavior of NOA. This variety in the exploitation 
operator of NOA will help in accelerating its convergence speed, 
in addition to avoiding stuck into local minima that might occur 
when searching in one direction. 

The exchange between the foraging stage and the cache is 
applied according to the following formula to maintain the bal- 
ance between exploration and exploitation operators through the 
optimization process: 


gn _ [FO Pom Pe % 
Eq. (3), otherwise 

where g is a random number between zero and one, and Py, 
represents a probability value that is linearly decreased from one 
to zero based on the current generation. Fig. 4(b) is presented to 
show the direction of the solutions generated using this stage, 
which affirms that this stage can steer the majority of the solu- 
tions in the direction of one region to cover the solutions there as 
much as possible while searching for the near-optimal solution. 
The flowchart of the exploration and exploitation processes in 
the first proposed strategy is depicted in Fig. 5 and listed in 
Algorithm 1. 


Algorithm 1 Foraging and storage strategy 


Output : Neots 
1. Initialize N nutcrackers using Eq.(19) 


2. Evaluate each X; and finding the one with the best fitness in x best 
3. t = 1; //the current iteration 

4. while (t < T) 

3s g is arandom number between 0 and 1. 

6 

7 

8 


for i=1:N 
for j= lid 
; if y >P,, /*Exploration phasel*/ 

9. Updating X!*7 using Eq. (1) and Eq. (20) 
10. Else /*Exploitation phase1*/ 
11. Updating X{*1 using Eq. (3) and Eq. (20) 
12. End if 
13. End for 
14. Update the current iterationt by t=t+1 
15. End for 


16. End while 


3.3.2. Reference memory 

After storing the seeds in the cache, the nutcrackers activate 
the spatial memory. The nutcrackers take a picture in their mind 
to find the cache using specific objects as a cue to help remember 
their cache. These nutcrackers rely almost solely on their memory 
of where those caches are located to survive through winter. 
Nutcrackers carefully examine and draw the storage location. 
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Hidden food is their only chance to reproduce and survive. More- 
over, nutcrackers seem to take large terrain features or tall trees 
as signs, while local features are not useful because they are 
covered in snow in winter. Next, we will simulate the behavior 
of nutcrackers in retrieving their cache. 


3.3.3. Cache-search and recovery strategy 

This strategy can be divided into two main stages: Cache- 
search and recovery stages, which are described in detail within 
the next two subsections: 


e Cache-search stage: Exploration phase 2 


When winter comes, the trees are bare, and it is time to switch 
from hiding mode to exploration and search mode. The nutcrack- 
ers begin in search of their caches. We call this phase the second 
exploration. The nutcrackers use a spatial memory strategy to 
locate their caches. Nutcrackers most likely use multiple objects 
as signals for a single cache. We will assume that each cache 
has only two objects for simplicity. The objects, or markers, will 
be at different angles from the hiding place. In this stage, the 
nutcrackers begin to take their initial positions/cache positions, 
generated by Eq. (19), in the search space (storage area). We 
defined these objects as Reference Points (RPs). In NOA, two RPs 
of each cache/nutcracker of the population can be defined using 
the following matrix: 


pat pat 
RP,, RPi, 


ppt Dot 
RPi, Pi, 
RPs = ; ; (5) 


ppt ppt 
RPyy  RPu4 


where RPE, and RPE, represent RPs (objects) of the cache po- 


sition xt of the ith nutcracker in the current generation t. To 
illustrate the relationship between the following three elements: 
the nutcracker, cache, and the reference point, we assume that 
the three elements represent the vertices of a triangle. Nutcrack- 
ers can be located in different locations with various angles of 
view. Fig. 6 depicts three different locations for the nutcracker 
in 3D space, with three different locations of RP for one cache. 
We assume that the origin point, 3D space, is the location of the 
cache. The angle-of-view of nutcrackers varies. The first location 
is at an acute angle, the second location is at an obtuse angle, and 
the third location is at a right angle. A nutcracker can be found 
anywhere in 3D space, on the coordinate axes or the diagonal 
axes. The same is true for RPs. 

Nutcrackers can recover hidden caches with high accuracy. 
However, according to relevant studies, approximately 20% of 
nutcracker attempts fail on the first try [83]. If the nutcracker 
cannot locate the food stored by the first RP, then it will identify 
it by the second RP. If the nutcracker cannot retrieve its cache 
a second time, then it will use the third reference. Two various 
equations are designed to generate the first and second RPs to 
improve the nutcracker exploration operation during searching 
for the hidden caches. The first RP is generated by updating the 
current position within the neighboring regions to find hidden 
caches around the nutcrackers. The mathematical formula for 
generating the first RP is as follows: 


RPE, = Xt + x! xt = 
ik = Xj +a-cos(@)-((X,—Xg)),k=1 (6) 


The second RP is generated by updating the current solution 
within the search space of the problem to help the nutcrackers 
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Fig. 4. Simulation of the exploration and exploitation operators in the Foraging and storage strategy. 


No 


Fig. 5. Flowchart of the exploration and exploitation process in the first proposed strategy. 


in exploring different regions for finding the hidden caches. The 
second RP is computed according to the following formula: 


>, =F - 3 +) > 

RP! , = Xf + a- cos (6)-((U-L)-%5+1)- th, k=2 (7) 
= 1 4 < Pip 

1= (8) 
0 otherwise 


—> 
where k denotes the RP index; RP, is the RP k of the cache 


position xt of the ith nutcracker in the current iteration t; x! 
is the cache of the ith nutcracker in the current iteration t; U 
and L are the upper and lower boundaries for a D-dimensional 
problem, respectively; a linearly decreases from one to zero; sf 
is a vector that includes values randomly generated between zero 
and one; X, is the cache position of the Ath nutcracker in the 
current iteration t; t3 is a random number of the second RP in 
the range [0, 1]; @ is a random in the range [0, z]; and Py» is 


a probability employed to determine the percentage of globally 
exploring other regions within the search space. 


Eqs. (6) and (7) are used to generate two RPs for each nutcracker 
to recover its cache. When the RP is close to the cache, it can 
easily retrieve it. We assume that the nutcrackers do not have 
enough experience to select the appropriate RPs (i.e., near the 
cache) in the first generation. However, nutcrackers gain more 
experience in the storing process with time. Nutcrackers visualize 
landmarks near their warehouses so they can easily retrieve them 
later. w in these equations was proposed to train the nutcrackers 
and give them enough experience to choose a suitable site for 
RPs. In NOA, @ prevents the early convergence of RPs toward 
the solution location (cache site). 9 is the angle-of-view of the 
nutcracker and is chosen at random from 0 to z. Fig. 7 shows 
the different viewing angles of the nutcracker: (a) 9 = 0; (b) 
0<d < m/2; (c) 0 = mw/2; (d) O< 6 < zm; (e) 0 = aw. When 
9 = 7/2, RP‘, = Xf, indicating that the RP position lies on the 


same cache position. To address this issue (RP), Eqs. (6) and (7) 
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Fig. 6. Three different locations for the nutcracker in 3-D space, with three 
different locations of RP for one cache. 


can be reformulated to the following equation: 


_ Xf + a-cos (0) - ((%j—X})) +r RP, if = 7/2 
RP; ~*~) oe yt _ yt 
X! +a -cos(6)- (Xi =)) 


other wise 


(9) 


and 
RP, = es ene): (Cae eae) Rife ee 
? ee (0 7 i) Eee i) “U2, other wise 
(10) 


where RPE, TEpEe sents the ith row, 1st column, in the matrix 


given in Eq. (5); RP* 2 Tepresents the ith row, 2nd column, in the 
matrix given in Eq. 5). Each row index in the matrix represents 
the cache/nutcracker index. Meanwhile, every column index in 
the matrix represents the RP index. RP is a random position. The 
third term of the first state of Eqs. (9) and (10) (ie., 0 = 2/2), 
has been added to avoid the early convergence of RPs toward a 
possible solution. w ensures that the NOA converges on a regular 
basis, allowing the nutcracker to improve its RP selection in the 
next generations. a can be calculated according to the following 
equation: 


gt 

t Tmax 
1-— , ifmn>.r. 
( =~) ' ; 


other wise 


where t and Tig indicate the current and maximum generations, 
respectively. The first state in Eq. (11) linearly decreases with 
the iteration to improve the convergence speed of the proposed 
algorithm. Meanwhile, the second state linearly increases to avoid 
being stuck into local minima, which might occur because of the 
first state. 

During the optimization process, all nutcrackers gain enough 
experience in selecting the appropriate RPs. These nutcrackers 
update the storage locations/solutions according to the appro- 
priate RPs. In NOA, all nutcrackers will apply the exploration 
mechanism to search for the most promising areas that might 
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contain a near-optimal solution. With each generation passed, 
the algorithm will explore and exploit areas around caches with 
appropriate RPs to avoid getting stuck in local minima. The new 
position of a nutcracker can be updated using the following 
equation: 


Xi. iff (Xt) <i PLA) 


ytt1 _ 
xi = > 
RP; ,, 


(12) 
other wise 


where yee is the new position/new cache of the ith nutcracker 
at iteration (t+1), x f is the current position/current cache of the 


ith nutcracker in the current iteration t, and RPE, is the first RP 
of the current cache of the ith nutcracker at iteration t. Eq. (12) 
was proposed to guide NOA to explore and exploit the promising 


regions of the RPh . If NOA does not obtain the most promising 
regions around RB , then it will explore them in other regions, 


such as the areas around the reference RP; 5, which is discussed 
below. 


e Recovery stage: Exploitation phase 2 


Fig. 8 depicts the possibilities that a nutcracker might en- 
counter when searching for its cache. The first major possibility 
is that a nutcracker can remember the location of his cache using 
the first RP. The two possibilities shown in Fig. 8 are as follows: 
the first one is that the food exists, and the second is that the 
food does not exist. This behavior can be mathematically modeled 
according to the following equation 


= Xi; if t3 <%% 
Xi = Xtar (xi _xt Rp! =e: horas 

tetra: (Xbest.j ii) +1- i1—Xej), otherwise 

(13) 

where x ‘+1 is the new position/cache of ith nutcracker at itera- 


tion (t+1), Xi ‘ is the current dimension/cache of the ith nutcracker 
in the current iteration t, ae is the best position/cache in itera- 


tion t, RPE, is the first RP of the current position/cache of the ith 
nutcracker in the current iteration t; 4, r2, 73 and t4 are random 
numbers created between zero and one, and C is the index of a 
solution selected randomly from the population. 

The first state of Eq. (13) simulates the first possibility (food 
exists). This notion means that some dimensions in this 
cache/solution will have a chance to survive for the next gen- 
eration. In reality, a cache that keeps pine seeds is good, so the 
nutcracker will prioritize food storage next time. The second state 
of Eq. (13) simulates the second possibility (food does not exist). 
In this case, the solution region is not promising, so the algorithm 
will apply an escape mechanism to avoid being stuck into local 
minima. Food from the cache is lost due to many reasons: either 
another nutcracker/bird stole the cache, or it was destroyed by 
certain natural factors, such as rain and snow. Eq. (13) state (1) 
allows a nutcracker to exploit promising regions in the search 
space to enhance the local search capability of NOA. Eq. (13) state 
(2) allows a nutcracker to explore random locations in the search 
space to enhance the global search capability of NOA. 


The second major possibility is that the nutcracker does not 
remember the location of his hidden food using the first RP, so 
he will search for it using the second RP. In reality, a nutcracker 
keeps many RPs in his memory that he will take during early 
storage. Nutcrackers recover caches on the first try (with the 
first reference), but the probability of failing on the first try 
is considered in the proposed algorithm. The nutcrackers that 
cannot find their cache use local landmarks that might disappear 
when the weather changes between autumn (storage time) and 
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Fig. 7. Different viewing angles of the nutcracker for both cache and RP. 


Recovery Possibilities 
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Nutcracker remember cache 
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Food exist in cache 


Food not exist in cache 


Fig. 8. Probable options for the Nutcracker to recover its cache. 


winter (recovery time). The spatial memory of the nutcracker, 
Eq. (12), is updated using the second RP: 


- ! (14) 
RP; 5, otherwise 


where Pu is the current position/current cache of the ith 


nutcracker in the current iteration t, and RPE, is the second RP 
of the current cache of the ith nutcracker at iteration t. Eq. (14) 
offers an opportunity for the NOA to explore new regions around 
the second RP and exploit promising areas where a potential 
solution could be found. In NOA, a nutcracker is assumed to find 
its cache using the second RP, so Eq. (13) is updated based on the 
second RP: 


Xip if TT < 16 

xitl a5 
, Xj +r: (Xpest.j = Xi) +12 - (RP%, a Xi) , otherwise 
(15) 


where r, f2, T5, and tg are random numbers in interval [0,1]. The 
first state of Eq. (15) allows the algorithm to intensify the local 
search around the most appropriate areas that involve the near- 
optimal solution. In the contract, the second state of Eq. (15) 
allows the algorithm to search for new areas in the search space 
to enhance its global search ability. In summary, the simulation of 
the recovery behavior (Fig. 8) can be summarized in the following 


es (n (16), 


equation: 


ses _ [F4(13) 
Eq. (15), 


if T7 < Tg 
i, = ; (16) 
other wise 

where t7 and tg are random numbers in the interval [0,1]. The 
first case in the above equation represents a nutcracker that 
remembers the hidden store, while the second case represents 
a nutcracker that does not remember the hidden store. Now, 
the trade-off between exploration behaviors about the first and 


second RPs is achieved according to the following equation: 


Eq. (12), if f(Eq. (12)) < f(Eq. (14)) 
Eq. (14), other wise 


t+1 _ 
oS 


(17) 


Finally, the exchange between the cache-search stage and the 
recovery stage is applied according to the following formula to 
maintain a balance between exploration and exploitation: 


if d > Pa 


other wise 


(18) 


Eq. (17), 
where ¢ is a random number between 0 and 1, and P,, repre- 
sents a probability value that is equal to 0.2, and this value was 
established from the experiments conducted later. According to 
the simulation experiments conducted to show the characteris- 
tics of the cache-search and recovery strategy and reported in 
Fig. 9, on one hand, the exploration operator within this strat- 
egy shows strong coverage, distributing capability around wide 
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Fig. 9. Simulation of the exploration and exploitation operators in the cache-search and recovery strategy. 
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Fig. 10. Flowchart of the exploration and exploitation process in the second proposed strategy. 


regions that represent the RPs following by the nutcrackers for 
finding the hidden caches. On the other hand, the exploitation 
operator pictured in Fig. 9(b) narrows the search within a small 
region to recover the pine seeds buried in the hidden cache. The 
flowchart of the exploration and exploitation processes in the 
second proposed strategy is depicted in Fig. 10, and listed in 
Algorithm 2. 


Algorithm 2 Cache-search and recovery strategy 
Output: Xnest 
Initialize N nutcrackers using Eq.(19) 
Evaluate each X; and finding the one with the best fitness in Kinase 
t = 1; //the current iteration 
while (t < Tingx) 
Generate RP matrix using Eq. (5), Eq.(9) and Eq.(10). 
Generate a random number @ between 0 and 1. 
for i=1:N 
if @ >P,, /*Exploration phase2*/ 
9. Updating Xf*? using Eq. (16) and Eq. (20) 
Else /*Exploitation phase2*/ 
11. Updating Xf** using Eq. (17) and Eq. (20) 
End if 
t=t+1 
End for 
End while 


BOSTON: Gr ed bo 
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4. Implementation of the proposed method for optimization 


The implementation of NOA is presented in this section. The 
proposed NOA is designed based on two main strategies. The first 
approach is the foraging and storage strategy, and the second one 
is the cache-search and recovery strategy. Each strategy simulates 
a time of nutcracker behavior. The two strategies equally impor- 
tant to NOA, which have the same probability to be selected. 
Similar to other population-based optimization algorithms, the 
population in NOA is initialized by 
Xt, =+(G-7) RM +i, 11,9. HD 8) 
where t_ denotes the generation index; i indicates the population 
index; Uj and Lj are the upper and lower boundaries for a D- 


dimensional problem, respectively; and RM is a random vector in 
the interval [0, 1]. Each nutcracker represents a feasible solution 
to the problem. 

The first proposed strategy is based on the designed explo- 
ration and exploitation stages called the first exploration and 
exploitation phases, respectively. The second proposed strategy is 
based on the designed exploration and exploitation stages called 
the second exploration and exploitation phases, respectively. In 
both strategies, the exploration and exploitation phases have the 
same importance to NOA; thus, they are randomly exchanged to 
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Fig. 11. Flowchart of NOA. 


simulate the behavior of the nutcrackers while applying the first 
or second proposed strategy according to their need. 

In the first proposed strategy, each nutcracker/source repre- 
sents a potential solution in the current iteration, and every cache 
represents a potential solution in that iteration. In the second 
proposed strategy, each nutcracker/cache represents a potential 
solution in the current iteration, and every RP represents a po- 
tential solution in that iteration. Each nutcracker has one food 
source and one cache in search space. The quality of the solution 
is evaluated for each new position of the nutcracker based on 
a fitness function. Then, the current position is updated if the 
solution quality of the new position is better than the solution 
quality of the current one. However, the nutcrackers in the NOA 
model remain at their current position if their solution quality is 
higher than the new one. In summary, the above concept can be 
expressed by Eq. (17). Finally, the pseudo-code and flowchart of 
NOA are shown in Algorithm 3 and Fig. 11, respectively. The time 
complexity of this algorithm in Big-O according to the steps listed 
is O(TmaxN). The advantages of NOA are listed as follows: 


e Easy to implement 

e Able to avoid falling into local optima for several optimiza- 
tion problems with various characteristics 

e Having a high convergence speed. 


While its main limitation considered as one of our future work is 
listed as follows: 

e Inability to balance its exploration and exploitation accord- 
ing to the needs of the optimization problem to save computa- 
tional cost and avoid local optimization entrapment. 
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XL POE ye Fx) 


tt1 
i vt 
Xi, 


(20) 
other wise 


5. Results and discussion 


This section first investigates the performance of the proposed 
optimizer to show its efficiency for 23 well-known mathemat- 
ical optimization problems employed widely in the literature 
to measure the exploitation and exploration capabilities of the 
newly-proposed optimizers [55,87]. These test functions belong 
to three categories: unimodal which contains only one global op- 
timum to investigate the exploitation operator of an optimization 
algorithm; high-dimensional multimodal which involves several 
local minima to observe the exploration operator; and fixed- 
dimensional multimodal which involves a limited number of 
dimensions to simulate the nature of the real-world optimization 
problems like the parameter estimation of PV models and fuel 
cell, and several else [88-90]. The characteristics, including the 
number of dimensions (D), search domain, and global optima, 
along with the mathematical model of these test functions, are 
presented in Appendix. Then, Three recent and challenging test 
suites on numerical optimization competitions: CEC-2014, CEC- 
2017, and CEC-2020 are utilized in this study to further validate 
the performance of NOA [91-93]. These benchmarks contain 30 
test functions that are unimodal, multimodal, hybrid, and com- 
position in nature, and they are designed to strongly challenge 
the previously proposed and the newly proposed metaheuristic 
algorithms. The characteristics of these test suites are described 
in Appendix. 
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Algorithm 3 Pseudo-code of NOA 
Input: population size N, the lower limits of variables L, the upper limits of variables 
U the current number of iteration t=0, and the maximum number of iterations Tmax} 
Output: the best solution found 

1. Initialize N nutcracker/solution using Eq.(19); 

2. Evaluate each solution and find the one with the best fitness in the population 

3. t = 1; //the current function evaluation// 

4. while (t < Tax) 

5. | Generate random numbers o and o, between 0 and 1. 
6. Ifo <o, //* Foraging and storage strategy*// 
Te 
8. 


g is arandom number between 0 and 1. 


for i=1:N 
ey for j= 1:d 
10. if ~ >P,, /*Exploration phase1*/ 
11. Updating X!*1 using Eq. (1) and Eq. (20) 
12. else /*Exploitation phase1*/ 
13. Updating X!*1 using Eq. (3) and Eq. (20) 
14. end if 
15. end for 
16. Update the current iterationt by t =t +1 
Ly: end for 
18. else //* Cache-search and recovery strategy *// 
19. Generate RP matrix using Eq. (5), Eq.(9) and Eq.(10). 
20. Generate a random number ¢ between 0 and 1. 
21. for i=1:N 
22. if  >P,, /*Exploration phase2*/ 
23. Updating X!*1 using Eq. (16) and Eq. (20) 
24. else /*Exploitation phase2*/ 
25. Updating X/*1 using Eq. (17) and Eq. (20) 
26. end if 
27. t=t+1 
28. end for 
29. end while 


To reveal the efficiency of the proposed NOA, it is extensively 
compared with three classes of existing optimization algorithms: 
(1) the first class includes some of the recently-published algo- 
rithms like gradient-based optimizer (GBO, 2020) [94], artificial 
gorilla troops optimizer (GTO, 2021) [27], Runge Kutta method 
(RUN, 2021) beyond the metaphor [95], African vultures op- 
timization algorithm (AVOA, 2021) [96], equilibrium optimizer 
(EO, 2020) [55], red Fox optimizer (RFO, 2021) [26], and slime 
mould algorithm (SMA, 2021) [87], (2) the second class contains 
some of the highly-cited, well-studied algorithms such as whale 
optimization algorithm (WOA, 2016) [17], gray wolf optimizer 
(GWO, 2014) [14], and salp swarm algorithm (SSA, 2017) [18] and 
(3) the last class includes AL-SHADE [97], L-SHADE [98], LSHADE- 
cnEpSin [92], and LSHADE-SPACMA [99] as highly-performing 
optimizers and winners of CEC competition. All of these compet- 
ing algorithms were put forth to address the global optimization 
problem solved in this study, so we used the controlling parame- 
ter values in our experiments as recommended by the authors in 
the cited paper, with the exception of N and Ting, which were 
set to 25 and 50000 to ensure an equal comparison. Table 2 
presents the controlling parameter values used in the conducted 
experiments for each rival algorithm. 

All algorithms used in our experiments were run indepen- 
dently 30 times and their optimization processes continued 
within each run until a function evaluation of 50,000 was reached. 
The results of those runs are analyzed to determine the average 
and standard deviation (Std) of the fitness values obtained within 
these runs, as well as the rank metric to determine the order of 
each algorithm in terms of the average fitness value. Additionally, 
the Wilcoxon rank-sum test and convergence curve metrics are 
used to demonstrate the significant difference between NOA’s re- 
sults and those of rival algorithms, as well as the fastest algorithm 
to the global solution. The experiments were carried out using 
MATLAB R2019a on a device with the following specifications: 
Intel(R) Core(TM) i7-4700MQ CPU @ 2.40 GHz, 32 GB RAM, and 
64-bit Windows 10 Pro. 
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The proposed NOA has three main effective controlling pa- 
rameters which have to be accurately optimized to reach the 
best performance; these parameters are P,, to determine the 
percentage of updating the current solution in the regions out of 
the current population for covering intractable regions, P,, to de- 
termine the probability of exchanging between the cache-search 
stage and the recovery stage, and 6 to determine if the current 
dimension will be updated within the upper and lower bound 
of the optimization problem as an attempt to avoid stuck into 
local minima. To pick the optimal values for these parameters, 
extensive experiments under various values for each parameter 
have been done and their conclusion is introduced in Figs. 12-14, 
which show that the best values for these parameters for the test 
functions F60 and F61 are 0.2, 0.4, and 0.05, respectively. 


5.1. Exploration and exploitation analysis 


First, the unimodal test functions (F1-F6) which have only a 
global best position are herein employed to evaluate the pro- 
posed algorithm’s exploitative behavior to demonstrate its ability 
to attack these global best solutions. Table 3 compares NOA’s 
performance to that of 10 other rival algorithms, including SSA, 
GBO, RUN, WOA, GTO, AVOA, EO, GWO, RFO, and SMA for six uni- 
modal test functions in terms of the average (Ave), and standard 
deviation (Std) of 30 fitness values. NOA is competitive to most 
strong optimizers like RFO, SMA, GTO, AVOA, GBO, and RUN for 
the first four unimodal test functions, and unfortunately inferior 
to four and six optimizers for F5 and F6, respectively, as shown 
in the ranking row. 

Also, this section evaluates NOA’s exploratory behavior on 
multimodal test functions (F7-F23), which contain multiple local 
minima. The average (Ave), and standard values of the fitness 
values obtained by the proposed and compared optimizers over 
30 independent runs are shown in Table 3. The results in this 
table demonstrate that NOA is competitive with some of the 
compared optimizers in terms of Ave for the majority of the 
multimodal test functions, inferior for three test functions (F7, F8, 
and F13), and superior to all rival methods in terms of Std values 
for most multimodal test functions. The comparison in this sec- 
tion demonstrates that NOA has an excellent exploratory operator 
due to its diverse exploratory behaviors at various stages of the 
optimization process, in addition to having a strong exploitation 
operator to explore these solutions found around the best-so-far 
solution. 


5.2. Comparison over CEC2014 


On the CEC-2014 test suite, additional validation is carried 
out to ensure that the introduced and other methods perform as 
expected. This suite of test functions is used to evaluate an algo- 
rithm’s ability to explore, escape from local minima, and exploit. 
It is divided into unimodal, multimodal, hybrid, and composition 
categories. Appendix contains a description of the characteristics 
of this test suite, in addition to the considered dimensions which 
are 10. Table 4 presents the Ave, and Std values in addition 
to the rank metric, which demonstrates that NOA is the best 
because it ranks first among all rival algorithms on all CEC-2014 
test functions except for F27, F30, F51, and F53. On all CEC- 
2014 test functions, the Ave rank row as the second row from 
the last within Table 4 affirms that NOA comes in the 1st rank 
with a value of 1.52, followed by GBO with a value of 4.48, 
while RFO comes in the last rank. The last row in this table 
shows the average standard deviation (Std) of all CEC-2014 test 
functions; this row demonstrates that the outcomes obtained by 
NOA are significantly similar since it has the lowest Std value of 
13.7, followed by SMA as the second-best one. The results of the 
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Table 2 
Parameter settings of the competitors and proposed NOA. 
Algorithms Parameters Value Algorithms Parameters Value 
Gwo (2014) ee constant a aa Linearly from 2 to 0 SMA (2020) . a 
: p 0.03 
Convergence constant a Decreases Linearly from 2 to 0 Beta 3 
WOA (2017) Spiral factor b 1 GTO (2021) in 8 
N 25 N 25 
Alpha (L,) 0.8 
a, 2 Beta (Lz) 0.2 
a2 1 Gamma (w) 25 
EO (2020) v 1 enn P, 06 
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Fig. 14. Sensitivity analysis of the parameter 6. 


Wilcoxon rank-sum statistical test for most test functions are less 
than 0.05, which confirms that the outcomes obtained by NOA 
are significantly different when compared to those obtained by 
the competitors, as shown in Table 5. 


5.3. Comparison over CEC2017 


The CEC-2017 test suite is used in this section to compare 
the performance of NOA and other optimizers [92]. It includes 
four families of mathematical functions: unimodal (F54—-F55), 
multimodal (F56-F62), composition (F63-F72), and hybrid (F73- 
F82). As previously stated, unimodal test functions are preferable 
for assessing the exploitability of optimization methods because 
they contain only one global optimal solution; multimodal test 
functions contain multiple locally optimal solutions, making them 
particularly well-suited for assessing the exploratory capabilities 
of newly introduced optimizers, and both composition and hybrid 
functions have been designed to assess the methods’ ability to 
avoid local optima. For all benchmark functions discussed in this 
section, the dimension is set to 10. Appendix shows the CEC-2017 
benchmark’s specifications. Table 6 shows the Ave, Std, p-value, 
and Rank values achieved by the proposed and rival optimizers in 
30 independent runs on this suite. This table shows that NOA is 
the best optimizer for all unimodal, multimodal, and hybrid test 
functions, and superior for 8 out of 10 multimodal test functions. 
Specifically, NOA could be superior for 27 out of 29 CEC-2017 test 
functions. 

The last two rows in Table 6 display the average of the rank 
values and Std values on all test functions for each algorithm, 
respectively. According to these rows, NOA has the potential to be 
the best with a value of 1.14 and 24.4 for average rank and Std, re- 
spectively. The Wilcoxon rank-sum test is utilized to calculate the 
p-value between NOA and each rival algorithm on each CEC-2017 
test function to determine the difference. Wilcoxon rank-sum 
test reveal that NOA has significantly-different outcomes from 
these of the rival optimizers since the p-values shown in Table 7 
accept the alternative hypothesis which supposes that there are 
the difference between the outcomes of the proposed and these of 
a rival algorithm. The experiments conducted in this section show 
that NOA belongs to the category of the strong optimizers because 
it could defeat GBO, RUN, GTO, AVOA, SMA, RFO, and EO as the 
most recent published optimizers as well as four well-established 
metaheuristic optimizers like WOA, GWO, and SSA. 


5.4. Comparison over CEC2020 


Further testing on the CEC-2020 test suite is carried out here 
to verify the performance of the suggested and other methods. An 
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algorithm’s ability to explore, exploit and avoid local minima can 
be tested utilizing this suite which contains 10 test functions and 
is divided into unimodal, multimodal, hybrid, and compositional. 
In Appendix, the properties of this test suite are laid out, and 
their dimensions are 10. Table 8 presents the ave, rank, and Std 
values obtained by analyzing the outcomes of 30 independent 
runs, which shows that NOA has superior performance for all 
test functions found in the CEC-2020 test suite. The average of 
the rank values and the Std values on all test functions for each 
algorithm are shown in the last two rows of Table 8, respectively. 
According to these rows, NOA has the potential to be the best, 
with average rank and standard deviation values of 1.00 and 
28.2, respectively. Additionally, It is necessary to calculate the 
p-value between NOA and each rival algorithm on each CEC- 
2020 test function to determine the difference between the two 
algorithms. The results of the Wilcoxon rank-sum tests reveal that 
NOA produces significantly different results from those produced 
by rival optimizers, as shown in Table 9. The p-values in Table 9 
support the alternative hypothesis, which assumes that there is a 
difference between the outcomes of the proposed algorithm and 
those produced by a rival algorithm. This section presents addi- 
tional experimental evidence that NOA belongs to the category of 
strong optimizers. 


5.5. Convergence speed analysis 


In this section, the convergence speed of NOA is compared to 
that of the rival algorithms to demonstrate their differences (see 
Fig. 15). This figure shows that all NOA convergence curves have 
an accelerated reducing pattern, which is particularly noticeable 
in the last half of the optimization process for four families of 
test functions (unimodal, multimodal, composition, and hybrid). 
According to the convergence curves shown in Fig. 15, the NOA 
optimizer is significantly faster than all of the other competing 
algorithms. This is due to its capabilities to balance between 
exploration and exploitation operators which aid in voiding stag- 
nation into local minima with accelerating convergence speed in 
the right direction of the most promising areas obtained by far, 
especially in the last half of the optimization process. 


5.6. Qualitative analysis 


Diversity, convergence curve, average fitness value, trajectory 
in 1st dimension, and search history are all metrics used in this 
section to describe the NOA performance during the optimization 
process. An individual’s average distance from other individuals 
is shown by the diversity metric; the convergence curve shows 
the best-fitness value achieved within each iteration; the average 
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Table 3 
Results of unimodal and multimodal test functions. 

F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 

Unimodal 

Fi Ave 0.00 x 10° 1.03 x 10-% 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 258 x 10-4 7.51 x 10° 0,00 x 10° 0.00 x 10° 
Std 0.00 x 10° 5.29 x 10-8 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 3.65 x 10-4 7.56 x 10-6! 0.00 x 10° 0.00 x 10° 
Rank 1 4 1 1 1 1 1 2 3 1 1 

2 Ave 0.00 x 10° 1.02 x 10! 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 246 x 10-73 9.20 x 10°%° 0.00 x 10° 0.00 x 10° 
Std 0.00 x 10° 4.07 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 2.70 x 107-73 414 x 10° 0.00 x 10° 0.00 x 10° 
Rank 1 4 1 1 1 1 1 2 3 1 1 

F3 Ave 0.00 x 10° 4.08 x 104 0.00 x 10° 0.00 x 10° 485 x 10° 0.00 x 10° 0.00 x 10° 9.87 x 10-8 8.70 x 10-4 0.00 x 10° 0.00 x 10° 
Std 0.00 x 10° 148 x 10? 0.00 x 10° 0.00 x 10° 3.02 x 104 0.00 x 10° 0.00 x 10° 1.04 x 10-2 1.21 x 1073 0.00 x 10° 0.00 x 10° 
Rank 1 4 1 1 5 1 1 2 3 1 1 

ei Ave 0.00 x 10° 2.61 x 10! 0.00 x 10° 0.00 x 10° 5.19 x 10! 0.00 x 10° 0.00 x 10° 1.41 x 10°22 155 x 1077 0.00 x 10° 0.00 x 10° 
Std 0.00 x 10° 1.40 x 10° 0.00 x 10° 0.00 x 10° 456 x 10! 0.00 x 10° 0.00 x 10° 1.01 x 10-22 2.02 x 1077 0.00 x 10° 0.00 x 10° 
Rank 1 4 1 1 5 1 1 2 3 1 1 

7 Ave 9.46 x 10! 4.12 x 107 8.78 x 10! 9.76 x 10! 9.74 x 10! 3.46 x 10-4 3.68 x 10° 9.47 x 10! 9.72 x 10! 9.87 x 10! 1.17 x 10° 
Std 6.29 x 107! 2.40 x 10? 1.10 x 10° 6.19 x 107! 6.48 x 10-7 1.66 x 1074 1.63 x 10°° 9.50 x 107! 1.61 x 10° 3.61 x 107! 1.36 x 10° 
Rank = 5, 11 4 9 8 2 1 6 7 10 3 

ra Ave 2.69 x 10°? 5.69 x 10-7 5.06 x 1075 7.39 x 1077 8.51 x 107! 2.52 x 10-4 1.03 x 10-6 5.00 x 107! 9.21 x 10° 433 x 107! 1.23 x 10°? 
Std 1.06 x 10-7 6.44 x 10° 1.93 x 10°> 7.93 x 10-7 481 x 107! 1.70 x 10-4 3.42 x 1077 6.70 x 10-3 3.16 x 107! 1.85 x 10-? 1.81 x 10-3 
Rank 7 1 4 2 10 5 3 9 11 8 6 

High-dimensional multimodal 

Ave 6.20 x 10-5 952 x 107! 1.00 x 10-4 8.18 x 1075 8.29 x 10-4 2.58 x 10°° 481 x 10° 745 x 10-4 1.13 x 1073 5.02 x 10-5 7.81 x 10-5 
Std 677 x 10> 7.32 x 10°? 2.49 x 10-5 466 x 10° 1.02 x 10-3 4.16 x 10-6 494 x 10° 426 x 10-4 3.18 x 1074 6.75 x 10-5 1.97 x 107-5 
Rank 4 11 7 5 9 1 2 8 10 3 6 

FS Ave —3.69 x 104 2.39 x 104 —2.68 x 104 —2.26 x 104 —3.88 x 104 —4.19 x 104 —4.18 x 104 —3.03 x 104 —1.60 x 104 —2.11 x 104 —4.19 x 104 
Std 438 x 103 1.31 x 10° 1.16 x 103 1.80 x 10? 459 x 107 1.14 x 10? 8.37 x 10! 5.94 x 107 7.02 x 107 1.61 x 107 5.80 x 10°? 
Rank = 5, 8 7 9 4 1 3 6 11 10 2 

ey Ave 0.00 x 10° 1.84 x 107 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 
Std 0.00 x 10° 8.44 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 
Rank 1 2 1 1 1 1 1 1 1 1 1 

rio Ave 888 x 10° 5.52 x 10° 8.88 x 107° 888 x 10% 888 x 10° 888 x 10° 888 x 10° 622 x 10-% 3.11 x 10°74 888 x 10° 8.88 x 10°-% 
Std 0.00 x 10° 255 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 2.51 x 10-% 251 x 10-5 0.00 x 10° 0.00 x 10° 
Rank 1 4 1 1 1 1 1 2 3 1 1 

ri Ave 0.00 x 10° 2.36 x 10°? 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 
Std 0.00 x 10° 5.81 x 10-4 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 
Rank 1 2 1 1 1 1 1 1 1 1 1 

rig Ave 1.18 x 10-4 1.07 x 10! 1.70 x 10-6 2.12 x 10-8 1.01 x 10-? 1.25 x 10-6 3.91 x 10° 1.56 x 10-2 2.05 x 107! 1.03 x 10-? 6.45 x 10-5 
Std 148 x 107° 4,90 x 10° 1.05 x 10-6 6.64 x 107" = 3.91 x 1073 1.15 x 1076 3.05 x 10°° 2.20 x 10-7 2.79 x 10°? 2.61 x 10-3 8.57 x 10-5 
Rank 6 11 4 2 7 3 1 9 10 8 5 

Fiz Ave 2.80 x 10°? 1.63 x 10? 3.09 x 10° 2.32 x 10°? 1.37 x 10° 1.70 x 10> 168 x 10° 3.38 x 10° 5.98 x 10° 5.25 x 10° 7.12 x 10-3 
Std 459 x 10-3 1.11 x 10° 437 x 10° 1.37 x 107% 8.32 x 107! 2.24 x 10-5 5.02 x 10° 2.62 x 10° 432 x 107! 6.61 x 10° 3.29 x 10-3 
Rank = 5 11 7 4 6 2 1 10 9 8 3 

Fixed-dimensional multimodal 

ria Ave 9.98 x 107! 9.98 x 107! 9.98 x 107! 6.87 x 10° 9.98 x 107! 9.98 x 107! 9.98 x 107! 9.98 x 107! 6.87 x 10° 1.27 x 10! 9.98 x 107! 
Std 0.00 x 10° 157 x 10°" 0.00 x 10° 5.50 x 10° 8.99 x 10° 0.00 x 10° 0.00 x 10° 0.00 x 10° 5.50 x 10° 212 x 10-3 = 1.08 x 10-4 
Rank 1 2 1 6 4 1 1 1 6 7 3 

Fis Ave 3.07 x 10-4 1.00 x 10-3 3.07 x 10-4 7.65 x 10-4 5.22 x 10-4 3.07 x 10-4 3.08 x 10-4 3.08 x 10-4 1.03 x 10-7 9.51 x 10-4 3.14 x 10-4 
Std 7.67 x 10° = 3.15 x 10-4 7.67 x 10-9 6,47 x 10-4 3.00 x 10-4 423 x 10-8 = 2.87 x 10-7 1.43 x 10°° 1.42 x 10°? 9.10 x 10-4 8.42 x 10-6 
Rank 1 8 1 6 5 1 2 2 9 7 3 

rig Ave 1.03 x 10° —1.03 x 10° —1.03 x 10° —1.03 x 10° —1.03 x 10° —1.03 x 10° —1.03 x 10° 1.03 x 10° —1.03 x 10° —-1.03 x 10° —1.03 x 10° 
Std 0.00 x 10° 497 x 10°" 0,00 x 10° 1.32 x 10° 8.02 x 10°" 0.00 x 10° 2.22 x 10° = 2.22 x 10716 9.14 x 10° =66.46 x 10°! 2.05 x 10-5 
Rank 1 1 1 1 1 1 1 1 1 1 1 

riz Ave 3.98 x 107! 3.98 x 107! 3.98 x 107! 3.98 x 107! 3.98 x 107! 3.98 x 107! 3.98 x 107! 3.98 x 10°! 3.98 x 107! 3.98 x 107! 3.98 x 107! 
Std 0.00 x 10° 214 x 10° 0.00 x 10° 3.41 x 107" 1.35 x 10-7 0.00 x 10° 0.00 x 10° 0.00 x 10° 1.30 x 10-8 2.83 x 10°! 6.50 x 107° 
Rank 1 1 1 1 1 1 1 1 1 1 1 

rig Ave 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 3.00 x 10° 
Std 0.00 x 10° 458 x 10° 444 x 10° 656 x 10°4 3.26 x 10° 0.00 x 10° 5.71 x 10-8 9.93 x 10-16 1.35 x 10% 2.66 x 10-° 8.23 x 10-4 
Rank 1 1 1 1 1 1 1 1 1 1 1 

rig Ave —3.86 x 10°  -3.86 x 10° —3.86 x 10° —3.86 x 10° —3.86 x 10° —3.86 x 10° —3.86 x 10° —3.86 x 10° —3.86 x 10° —-3.86 x 10° —3.86 x 10° 
Std 0.00 x 10° 974 x 10° 0.00 x 10° 6.80 x 10°" = =3.11 x 10°? 0.00 x 10° 0.00 x 10° 0.00 x 10° 3.89 x 10-3 1.99 x 10-8 2.65 x 10°? 
Rank 1 2 1 1 1 1 1 1 1 1 1 

p20. Ave —3.32 x 10° —3.26 x 10° —3.26 x 10° —3.32 x 10° —3.16 x 10° —3.32 x 10° —3.26 x 10° —3.26 x 10° —3.26 x 10° —3.26 x 10° —3.20 x 10° 
Std 0.00 x 10° 8.43 x 10°? 8.41 x 10°? 420 x 10° 5.60 x 10-2 0.00 x 10° 8.41 x 10°? 8.41 x 10°? 8.52 x 10°? 8.41 x 10°? 7.37 x 10-8 
Rank 1 2 2 1 4 1 2 2 2 2 3 

21 Ave —1.02 x 10! 7.63 x 10° —1.02 x 10! 1.02 x 10! —1.02 x 10! —1.02 x 10! 1.02 x 10! 1.02 x 10! 7.63 x 10°  —5.08 x 10° —1.02 x 10! 
Std 0.00 x 10° 3.57 x 10° 0.00 x 10° 642 x 10°" 3.78 x 10-4 0.00 x 10° 0.00 x 10° 0.00 x 10° 3.57 x 10° 3.22 x 10-7 5.13 x 105 
Rank 1 4 1 1 1 1 1 1 4 3 1 

r22_~—sAve —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —1.04 x 10! —5.09 x 10° —1.04 x 10! 
Std 1.78 x 105 1.15 x 10° 0.00 x 10° 1.60 x 10° 5.69 x 10-4 1.78 x 10° 0.00 x 10° 0.00 x 10° 2.79 x 10° 2.34 x 10-7 1.65 x 10° 
Rank 1 1 1 1 1 1 1 1 1 3 1 

F23~—CAve —1.05 x 10! —6.67 x 10° —1.05 x 10! —1.05 x 10! 1.05 x 10! 1.05 x 10! 1.05 x 10! 1.05 x 10! -1.05 x 10' = -5.13 x 10° 1.05 x 10! 
Std 0.00 x 10° 5.47 x 10° 0.00 x 10° 545 x 10" 136 x 10-4 0.00 x 10° 0.00 x 10° 3.97 x 10-5 1.73 x 10-5 2.36 x 1077 7.69 x 10-6 
Rank 1 4 1 1 1 1 1 1 1 3 1 


Bold values indicate the best findings. 


fitness value shows the average of all individuals’ fitness values 
throughout every one of those iterations; the trajectory curve 
shows how the 1st dimension of a solution is changed over time 
as it moves through the optimization process; the search history 


discloses the positions attained by the NOA optimizer during the 
optimization process. 

Fig. 16 shows that NOA’s diversity metric decreases over time, 
as shown in the second column, indicating that NOA’s efficiency 
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Table 4 
Results of unimodal, multimodal, hybrid, and composition CEC-2014 test functions. 

F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 

Unimodal 

r4 Ave 1.00 x 107 4.18 x 10° 8.51 x 103 1.24 x 10° 4.95 x 10° 5.09 x 10? 1.38 x 105 5.20 x 104 7.27 x 10° 2.88 x 10° 1.38 x 10° 
Std 8.11 x 10-6 3.66 x 10° 3.78 x 104 1.23 x 10° 4.65 x 10° 5.68 x 10? 1.18 x 105 6.65 x 104 4.92 x 10° 4.25 x 10° 5.88 x 104 
Rank 1 8 3 5 10 2 6 4 1 9 7 

_ Ave 2.00 x 107 3.10 x 10° 2.57 x 10° 3.37 x 10? 8.41 x 10° 9.91 x 10° 3.34 x 10? 1.43 x 10° 1.73 x 107 3.20 x 10? 7.34 x 10? 
Std 7.29 x 10-1 2.91 x 10? 9.23 x 10! 5.07 x 10? 6.03 x 10° 1.76 x 107 3.77 x 10? 1.44 x 10? 6.59 x 10’ 2.99 x 10? 3.47 x 10? 
Rank 1 5 2 8 10 3 7 4 a 6 9 

FG Ave 3.00 x 10? 2.87 x 10? 3.12 x 10? 9.67 x 107 4.92 x 104 3.08 x 10? 1.16 x 103 439 x 107 5.87 x 10? 1.30 x 104 2.39 x 10? 
Std 2.19 x 10-8 2.06 x 10? 2.14 x 10! 3.80 x 10? 2.91 x 104 1.14 x 10! 5.52 x 10? 2.03 x 10? 3.95 x 10? 151 x 104 2.53 x 10? 
Rank 1 8 3 5 12 2 6 4 10 a 7 

Multimodal 

7 Ave 4.25 x 10° 4.25 x 10° 4.20 x 10? 4.18 x 107 441 x 10° 4.23 x 10° 419 x 10° 427 x 10° 4,30 x 10? 4,32 x 10° 4.21 x 10° 
Std 1.54 x 10! 155 x 10! 1.66 x 10! 1.60 x 10! 2.78 x 10! 1.63 x 10! 1.90 x 10! 1.41 x 10! 2.04 x 10! 1.69 x 10! 1.63 x 10! 
Rank 7.00 6.00 3.00 1.00 11.00 5.00 2.00 8.00 9.00 10.00 4.00 

_ Ave 5.18 x 10? 5.20 x 107 5.20 x 107 5.20 x 10? 5.20 x 10? 5.20 x 10? 5.20 x 10? 5.20 x 10? 5.20 x 107 5.20 x 107 5.19 x 107 
Std 6.11 x 10° 7.70 x 10°? 9.68 x 10°? 1.62 x 107! 1.14 x 107! 9.22 x 10°? 472 x 10? 6.74 x 10-7 1.04 x 107! 5.45 x 10-5 3.66 x 10° 
Rank 1 4 6 9 10 8 5 7 12 3 2 

29 Ave 6.00 x 10? 6.03 x 107 6.04 x 107 6.06 x 107 6.08 x 107 6.05 x 107 6.06 x 10? 6.02 x 10? 6.02 x 107 6.10 x 107 6.04 x 107 
Std 4.07 x 1071 1.78 x 10° 1.40 x 10° 1.37 x 10° 1.54 x 10° 1.62 x 10° 1.36 x 10° 1.49 x 10° 1.52 x 10° 1.07 x 10° 1.94 x 10° 
Rank 1 4 6 9 11 7 8 2 3 12 5 

30 AVE 700.0472 700.3388 700.1710 700.3679 701.0390 700.3071 700.3811 700.0504 702.0864 705.1798 700.2654 
Std 3.14 x 10? 1.29 x 107! 8.69 x 10°? 2.29 x 107! 452 x 107! 3.21 x 107! 1.90 x 107! 3.32 x 10°? 2.78 x 10° 4.67 x 10° 1.28 x 107! 
Rank 1 4 3 8 9 7 5 2 10 a] 6 

F31 Ave 8.00 x 10? 8.20 x 107 8.21 x 107 8.23 x 107 8.38 x 107 8.21 x 107 8.12 x 10? 8.05 x 10? 8.08 x 107 8.48 x 107 8.02 x 107 
Std 2.11 x 10-4 6.79 x 10° 1.06 x 10! 7.93 x 10° 1.43 x 10! 8.75 x 10° 5.70 x 10° 2.89 x 10° 3.23 x 10° 1.84 x 10! 1.09 x 10° 
Rank 1 6 7 9 10 8 5 3 4 12 2 

£32 Ave 9.06 x 107 9.20 x 10? 9.26 x 10? 9.37 x 10° 9.46 x 10° 9.32 x 10? 9.35 x 10? 9.11 x 10? 9.15 x 10? 9.54 x 10° 9.15 x 10? 
Std 2.44 x 10° 8.81 x 10° 1.06 x 10! 6.95 x 10° 1.48 x 10! 1.31 x 10! 1.02 x 10! 5.11 x 10° 7.15 x 10° 9,32 x 10° 7.99 x 10° 
Rank 1 5 6 9 W 7 8 2 4 12 3 

F33 Ave 1.00 x 10? 1.52 x 10? 1.37 x 10? 1.20 x 10° 1.52 x 10° 1.53 x 10° 1.18 x 103 1.18 x 103 1.31 x 10? 2.09 x 10? 1.17 x 103 
Std 1.54 x 10° 2.86 x 10? 2.39 x 10? 1.30 x 107 2.49 x 10° 2.87 x 10° 1.21 x 10? 1.15 x 10? 1.89 x 107 3.47 x 10° 8.96 x 10! 
Rank 1 8 7 5 9 10 3 4 6 12 2 

a Ave 1.46 x 10? 2.38 x 10? 1.92 x 10? 171 x 10? 2.91 x 10° 186 x 10? 2.09 x 10? 1.70 x 10° 1.84 x 10? 2.71 x 10? 1.98 x 10? 
Std 1.48 x 107 4.29 x 107 3.44 x 10? 1.95 x 10? 5.11 x 10? 2.55 x 107 3.30 x 10? 3.34 x 10? 3.83 x 107 2.70 x 107 3.58 x 107 
Rank 1 9 6 3 12 5 8 2 4 10 7 

ras (AWE 1200.082 1200.297 1200.228 1200.216 1200.796 1200.402 1200.368 1200.336 1200.810 1200.253 1200.187 
Std 5.75 x 10? 1.70 x 107! 1.32 x 107! 143 x 107! 271 x 107! 1.72 x 107! 2.37 x 107! 2.11 x 107! 6.53 x 107! 2.95 x 107! 7.65 x 10-7 
Rank 1 4 3 5 1 9 8 7 10 6 2 

rag «SAVE 1300.089 1300.295 1300.294 1300.393 1300.348 1300.260 1300.457 1300.067 1300.193 1300.546 1300.251 
Std 3.41 x 10°? 1.17 x 107! 8.19 x 10°? 1.78 x 107! 1.29 x 107! 1.60 x 107! 2.37 x 107! 4.05 x 10°? 5.53 x 10°? 2.23 x 107! 8.93 x 10°? 
Rank 2 6 4 9 8 7 a 1 3 10 5 

r37_—(AWe 1400.141 1400.263 1400.342 1400.395 1400.304 1400.360 1400.330 1400.173 1400.328 1400.443 1400.204 
Std 5.51 x 10? 1.70 x 107! 1.17 x 107! 155 x 107! 2.21 x 107! 2.64 x 107! 3.23 x 107! 7.64 x 107? 2.24 x 107! 3.02 x 107! 8.35 x 10-7 
Rank 1 4 6 8 7 9 10 2 5 a 3 

rags AVE 1500.704 1501.619 1501.905 1502.776 1506.984 1503.018 1503.884 1501.027 1501.553 1516.130 1501.125 
Std 2.52 x 1071 7.50 x 107! 8.76 x 107! 1.18 x 10° 2.32 x 10° 1.74 x 10° 1.80 x 10° 2.99 x 1071 7.46 x 107! 5.48 x 10° 5.27 x 107! 
Rank 1 4 5 8 10 7 9 2 6 12 3 

F39—Ss AVE 1601.922 1602.837 1602.933 1602.655 1603.393 1603.048 1603.024 1602.230 1602.618 1604.103 1602.640 
Std 449 x 10°! 3.58 x 107! 5.45 x 107! 417 x 107! 3.12 x 107! 454 x 107! 2.99 x 107! 467 x 107! 546 x 107! 2.52 x 107! 3.33 x 107! 
Rank 1 8 6 5 W 7 9 2 3 12 4 

Hybrid 

F40 Ave 1.71 x 10? 6.18 x 10? 2.33 x 10? 6.87 x 10? 2.03 x 10° 2.25 x 103 8.06 x 10? 436 x 103 4.08 x 104 6.96 x 10? 7.91 x 103 
Std 5.98 x 10° 3.52 x 10? 3.21 x 10? 3.05 x 10? 3.86 x 10° 2.75 x 107 432 x 103 2.26 x 10? 1.05 x 10° 1.04 x 104 5.82 x 107 
Rank 1 5 3 6 12 2 9 4 1 7 8 

F41 Ave 1.80 x 10? 1.28 x 10* 1.96 x 10? 1.01 x 104 1.19 x 104 187 x 10? 1.10 x 104 8.74 x 10? 1.23 x 104 8.36 x 10? 1.88 x 104 
Std 6.62 x 107! 1.02 x 104 9.41 x 10! 3.39 x 10? 1.18 x 104 4.03 x 10! 7.50 x 103 5.95 x 10? 7.67 x 10? 6.04 x 107 1.51 x 104 
Rank 1 10 3 6 8 2 7 5 9 4 1 

rays Ave 1900.169 1903.329 1902.593 1903.068 1905.922 1902.772 1903.983 1901.714 1902.745 1910.302 1901.843 
Std 1.09 x 1071 1.05 x 10° 1.21 x 10° 9.14 x 107! 1.37 x 10° 1.09 x 10° 1.13 x 10° 8.04 x 107! 1.12 x 10° 5.64 x 10° 5.65 x 107! 
Rank 1 8 5 7 1 6 9 2 4 12 3 

nas Ave 2.00 x 10? 3.12 x 10° 2.08 x 10? 3.97 x 10? 8.11 x 10? 2.06 x 10° 6.96 x 10? 2.12 x 10? 7.27 x 10? 1.09 x 104 5.23 x 10? 
Std 455 x 1071 1.90 x 10? 6.49 x 10! 1.99 x 10° 4.26 x 10? 438 x 10! 5.99 x 10? 6.51 x 10! 446 x 10? 8.86 x 10? 468 x 10? 
Rank 1 5 3 6 W 2 9 4 10 12 7 

Pia Ave 2.10 x 10? 5.08 x 10? 2.49 x 10? 5.06 x 10? 8.87 x 104 2.46 x 10? 9.98 x 10? 2.40 x 10? 9.63 x 10? 8.09 x 10? 465 x 10? 
Std 2.60 x 107! 2.65 x 10? 2.57 x 10? 2.61 x 10° 1.56 x 10° 2.80 x 10? 7.23 x 10° 1.96 x 10? 4.37 x 10? 5.70 x 10? 3.86 x 10? 
Rank 1 7 4 6 12 3 1 2 10 8 5 

FAS Ave 2.20 x 10? 2.26 x 103 2.27 x 103 2.29 x 103 2.29 x 103 2.24 x 103 2.27 x 10? 2.24 x 10? 2.30 x 107 2.49 x 10? 2.23 x 10? 
Std 2.32 x 1071 4.62 x 10! 6.74 x 10! 5.75 x 10! 7.29 x 10! 3.06 x 10! 6.17 x 10! 499 x 10! 5.77 x 10! 1.40 x 10? 2.97 x 10! 
Rank 1 6 8 10 9 3 7 4 a 12 2 


is gradually shifting from exploration to exploitation to explore 
most regions in the search space at the beginning of the optimiza- 
tion process to avoid stagnation into local minima while reducing 
diversity quickly during the second half of the optimization pro- 
cess to accelerate the convergence toward the most promising 
region obtained so-far. 
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(continued on next page) 


During the last half of the optimization process, when popu- 
lation diversity is reduced and the exploratory process is largely 
transformed into the exploitative phase, the NOA convergence 
curves show an accelerated reducing pattern on various test 
functions as depicted through the third column in Fig. 16. From 
this column, it is clear that NOA has a slow convergence at the 
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F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 

Composition 

FAG Ave 2.50 x 10? 2.63 x 10? 2.50 x 10? 2.50 x 103 2.62 x 10? 2.50 x 10? 2.50 x 10? 2.63 x 10? 2.63 x 10? 2.50 x 10? 2.50 x 107 
Std 0.00 x 10° 1.80 x 107° 0.00 x 10° 0.00 x 10° 4.06 x 10! 0.00 x 10° 0.00 x 10° 1.68 x 10°? 4.02 x 10° 0.00 x 10° 0.00 x 10° 
Rank 1 10 2 3 8 4 5 9 11 6 7 

p47 Ave 2.51 x 10° 2.53 x 10? 2.54 x 10? 2.58 x 10° 2.58 x 10? 2.58 x 10? 2.58 x 10? 2.55 x 10? 2.54 x 10° 2.60 x 10? 2.55 x 10? 
Std 5.38 x 10° 1.61 x 10! 2.01 x 10! 3.05 x 10! 3.14 x 10! 3.05 x 10! 3.01 x 10! 3.70 x 10! 3.46 x 10! 142 x 10! 3.16 x 10! 
Rank 1 2 3 9 8 11 10 5 4 12 6 

F48 Ave 2.62 x 103 2.69 x 10? 2.68 x 10? 2.70 x 103 2.69 x 107 2.70 x 107 2.69 x 10? 2.70 x 103 2.70 x 103 2.70 x 103 2.68 x 10? 
Std 5.89 x 10° 2.81 x 10! 2.56 x 10! 9.51 x 107! 9.32 x 10° 8.53 x 10° 137 x 10! 1.44 x 10! 1.29 x 10! 0.00 x 10° 2.58 x 10! 
Rank 1 4 2 11 5 8 6 7 9 12 3 

rag Ave 2700.092 2700.202 2700.243 2700.181 2700.378 2700.229 2700.354 2700.068 2700.142 2700.432 2700.231 
Std 2.48 x 107 8.86 x 10°? 9.59 x 10°? 9.16 x 10°? 1.72 x 107! 1.23 x 107! 158 x 107! 2.70 x 10-7 1.82 x 10! 1.50 x 107! 6.70 x 10°? 
Rank 2 4 7 3 10 6 9 1 12 8 5 

F50 Ave 2.78 x 103 3.01 x 10? 2.83 x 10? 2.88 x 103 3.10 x 10? 2.84 x 103 2.90 x 10? 3.02 x 10? 2.98 x 10? 2.90 x 10? 2.89 x 103 
Std 9.85 x 10! 1.71 x 10? 9.50 x 10! 5.83 x 10! 1.13 x 107 9.34 x 10! 0.00 x 10° 1.12 x 10? 146 x 107 0.00 x 10° 5.01 x 10! 
Rank 1 9 2 4 12 3 6 11 8 7 5 

E51 Ave 3.02 x 10? 3.22 x 10° 3.00 x 10? 3.00 x 10? 3.38 x 10? 3.00 x 10? 3.00 x 10? 3.22 x 10° 3.27 x 10° 3.00 x 10? 3.00 x 10? 
Std 5.04 x 10! 5.94 x 10! 0.00 x 10° 0.00 x 10° 148 x 10? 0.00 x 10° 0.00 x 10° 5.14 x 10! 7.62 x 10! 0.00 x 10° 0.00 x 10° 
Rank 7 9 1 2 12 3 4 8 10 5 6 

a Ave 3.09 x 10° 1.19 x 10° 2.69 x 10° 3.58 x 10? 1.77 x 10° 1.12 x 10° 3.61 x 10? 2.41 x 10° 3.77 x 10° 3.10 x 10° 3.57 x 10? 
Std 3.64 x 10! 4.37 x 10° 6.91 x 10° 3.86 x 10? 5.26 x 10° 5.96 x 10° 455 x 10° 6.18 x 10° 8.60 x 10° 0.00 x 10° 3.90 x 10? 
Rank 1 8 11 4 9 7 5 10 12 2 3 

F53 Ave 3.50 x 10? 442 x 10? 3.87 x 10? 430 x 103 5.18 x 10? 3.98 x 10? 459 x 103 3.74 x 10? 445 x 10? 3.37 x 10? 3.62 x 10? 
Std 3.10 x 10! 6.69 x 107 3.14 x 10? 5.31 x 107 1.19 x 10? 474 x 10? 498 x 107 2.94 x 107 7.85 x 107 6.76 x 10? 2.34 x 107 
Rank 2 8 5 7 12 6 10 4 9 1 3 

Ave. Rank 1.52 6.21 448 6.24 9.97 5.62 7.14 4,38 8.07 9.17 4,90 
Ave. Std 1.37 x 10! 2.76 x 104 2.44 x 104 470 x 10° 2.12 x 10° 2.02 x 104 496 x 10° 2.32 x 104 2.39 x 10° 143 x 10° 3.18 x 10? 


Bold values indicate the best findings. 


beginning of the optimization process to cover as much search 
space as possible to avoid getting stuck in local minima, then 
it is maximized in the last half of this process due to shifting 
from exploration to exploitation of the most promising regions 
obtained. 

Using the same graph, the average fitness history curve shows 
that NOA’s competitiveness among solutions to the validated test 
functions has decreased over time. This is because all solutions 
are now focused on exploiting the areas around the best-so-far 
solution, so the fitness values of all solutions are mostly the 
same. Also, Fig. 16 shows the trajectory of NOA’s search for the 
optimal position of the first dimension as it gradually explores 
all aspects of the search space. To find a better solution quickly, 
the exploratory approach is being replaced by an exploitative 
one that narrows the scope of the search to one aspect. NOA’s 
trajectory curve shows that it begins with an exploratory trend, 
then transitions to an exploitation one to find better outcomes 
before terminating the optimization process. Last but not least, 
the history of NOA positions is depicted in the final column of 
Fig. 16. As can be seen in this column, NOA does not follow 
the same pattern for every transfer function. For example in the 
case of F54, NOA first explores the entire search space before 
narrowing its scope near the interval of 0 and —50 in an attempt 
to find the optimal solution. The search history graph also shows 
that NOA has a more dispersed pattern for the multimodal and 
composition test functions, whereas its performance for the uni- 
modal test function is more concentrated around the optimum 
points. 


5.7. The overall effectiveness of the proposed algorithm 


NOA has been evaluated separately in the previous sections 
using four test suites: CEC2005, CEC2014, CEC2017, and CEC2020, 
and compared to ten well-established metaheuristic algorithms, 
but the overall performance of NOA across all test suites needs 
to be elaborated. As a result, this section compares the overall 
performance of NOA and the other algorithms across all test 
functions of each benchmark. Table 10 shows the average rank 
values and standard deviations for each test suite. This table also 
shows the overall effectiveness of the proposed algorithm and 
other competing algorithms using an additional metric known as 
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overall effectiveness (OE), which is calculated using the formula 
below [100]: 


N' -L; 
OE (%~) = ——— #100 (21) 
N 

where N’ denotes the number of mathematical functions in each 
test suite and L; stands for the number of test functions, which 
NOA failed to be the best compared to all the optimizers. Accord- 
ing to the findings in this table, NOA could be superior in terms 
of Std, Rank, and OE for three test suites: CEC2014, CEC2017, 
and CEC2020 when compared to all the rival optimizers. Unfortu- 
nately, NOA could not achieve better outcomes compared to GTO 
using CEC2005, but their results are slightly competitive. Overall 
evaluation defined in the last three rows in this table confirms 
that NOA is the best-performing optimizers since it outperforms 
all in terms of Avg. Std, Avg. Rank, and Avg. OE(%). This efficiency 
is due to the variation in the optimization process of NOA, where 
it has two various mechanisms with two distinct exploration 
and exploitation operators. The first mechanism occurring in the 
summer and fall periods starts with an exploration operator to 
search for the pine seeds in different regions within the search 
space, followed gradually by an exploitation operator to store 
the explored seeds in an appropriate cache. On the other hand, 
the second mechanism occurs in the winter and spring seasons 
when NOA retrieves the caches using the spatial memory strategy 
based on marking the hiding location of the caches using different 
markers, or objects at various angles. This phase is the second 
exploration operator simulated by NOA to find the hiding location 
which include the caches. Afterward, the second exploitation 
operator will be called to recover the stored pine seeds. Due to 
these various exploration and exploitation operators simulated 
from the nutcracker’s behaviors, NOA could achieve the superior 
findings explained before. 


5.8. Comparison with CEC-2014 winners 


This section is added to demonstrate how well our proposed 
NOA performs in comparison to the CEC2014 winners: L-SHADE 
and an adaptive variant of L-SHADE (AL-SHADE). The population 
size for the proposed NOA in the experiments conducted herein 
is 100, while the maximum number of function evaluations for 
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Fig. 16. Diversity, convergence curve, average fitness history, trajectory and search history. 
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Table 5 
P-values on CEC-2014 test suite (F24—-F53). 
Fun SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
F24 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1 10-1 10-1 10-11 qo-"1 10-1 10-11 10-1 10-1 10-1 
F25 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 40-11 qo" 10-11 40-11 40-01 10-11 40-11 10-11 10-11 
F26 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 1.29 x + 
10-11 40-1 qo-11 10-11 40-11 40-11 10-11 40-11 10-11 10-11 
F27 2.21 x + 5.22 x - 183 x - 3.30 x + 2.33 x + 2.20 x + 9.74 x + 2.35 x + 3.30 x + 7417 x + 
10-4 10-2 107! 10-7 10-4 10-5 105 10-5 10-7 10~’ 
F28 1.30 x - 4.20 x - 5.19 x - 3.01 x + 1.17 x + 1.08 x + 1.20 x + 3.68 x + 9.50 x + 1.34 x + 
10"! 10"! 10-? 10-7 10°? 10? 10-1 to" 10-6 10-5 
F29 8.99 x + 1.09 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 1.73 x + 7.38 x + 3.02 x + 4.50 x + 
10-11 10°” 10-1 10-11 10°" 10" 1077 10° 10-1 10°" 
F30 3.02 x + 5.19 x + 3.02 x + 3.02 x + 4.62 x + 9.92 x + 7.28 x - 3.02 x + 3.02 x + 3.02 x + 
10-11 1077 10" 10-1" 10°” 10" 10"! 10°" 10-11 10-11 
F31 1.21 x + 1.20 x + 1.21 x + 1.21 x + 1.21 x + 1.21 x + 1.18 x + 1.21 x + 1.21 x + 1.21 x + 
10-12 10-12 10-72 10-12 10-2 10-12 10-12 10-12 10-12 10-2 
F32 487 x + 3.25 x + 2.96 x + 2.96 x + 5.38 x + 3.27 x + 2.43 x + 1.82 x + 2.96 x + 2.82 x + 
10-1 to to 10-1 to“ 10-1 10-7 10-* 10-1 10- 
F33 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 2.99 x + 
10-11 40-11 40-11 10-11 40-11 10-11 10-11 40-11 10-11 10-11 
F34 1.07 x + 5.60 x + 1.76 x + 3.02 x + 3.83 x + 1.55 x + 1.44 x + 5.87 x + 3.02 x + 2.83 x + 
10°° 1077 1071 10-1 10-6 10° 10-3 10-4 10-1 10-° 
F35 3.01 x + 2.84 x + 1.47 x + 3.02 x + 2.03 x + 3.20 x + 8.48 x + 2.38 x + 6.77 x + 9.21 x + 
10-7 10-4 107 to 10° 10°° 10° 10~’ 10-5 10-5 
F36 8.99 x + 1.96 x + 3.02 x + 6.70 x + 5.07 x + 3.02 x + 1.37 x + 2.87 x + 1.33 x + 462 x + 
to“ 10-1 to" to 1o-° 10-1" 10-3 10-1 10-” 10-1 
F37 2.88 x + 8.89 x + 9.92 x + 469 x + 9.06 x + 1.36 x + 5.94 x - 2.38 x + 4.62 x + 464 x + 
10-6 10°” 10" 10-8 10-® 1077 10-7 1077 10-"° 10-3 
F38 111 x + 4.18 x + 9.92 x + 3.02 x + 2.61 x + 5.57 x + 8.12 x + 1.64 x + 3.02 x + 3.37 x + 
10-6 10°° 10" 10-1" 10°” 10° 10-4 10-5 10-1 10-5 
F39 7.77 x + 1.17 x + 7.04 x + 3.02 x + 6.12 x + 5.07 x + 8.31 x + 1.87 x + 3.02 x + 9.83 x + 
10° 10° 10-7 10-1 1o- 10-1 10-3 10-5 10-1 10-* 
F40 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 qo-1 10-1 10-11 10-1 10-1 10-11 10-11 10-1 10-1 
F41 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 40-1 qo" 10-11 40-11 40-11 10-11 40-11 10-11 10-11 
F42 3.02 x + 4.98 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.34 x + 
10-11 10-1 10-1 10-11 10-11 10-1 10-11 10-11 10-11 10-1 
F43 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 10-1 10-1 10-11 10-11 10-1 10-11 10-11 10-1 10-11 
F44 3.02 x + 3.34 x + 3.02 x + 3.02 x + 5.49 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 40-11 qo-11 10-11 40-11 10-11 10-11 40-11 10-11 10-11 
F45 3.02 x + 8.15 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 450 x + 3.02 x + 3.02 x + 2.15 x + 
10-11 40-11 40-11 10-11 40-11 10-11 10-11 40-11 10-11 10-1 
F46 1.21 x + NaN + NaN + 1.66 x + NaN + NaN + 5.99 x + 1.21 x + NaN + NaN + 
10-12 10-11 10-13 10-12 
F47 1.61 x + 5.51 x + 3.02 x + 3.02 x + 5.73 x + 1.27 x + 8.29 x + 6.72 x + 1.21 x + 2.58 x + 
10-1? 10-1” to" to 1o-” 10-1 10-6 10-1 10-? 10- 
F48 418 x + 3.77 x + 457 x + 2.95 x + 7.72 x + 1.99 x + 1.28 x + 2.61 x + 457 x + 2.16 x + 
10°° 10°” 10°? 10° 10°" 10" 10°" 10°” 10°? 10°" 
F49 7.60 x + 5.00 x + 6.53 x + 1.09 x + 1.07 x + 8.89 x + 8.12 x + 1.29 x + 3.34 x + 6.07 x + 
1077 10°° 10-° 10-7 10° 10-1 10-4 10-6 10-1 10-1" 
F50 1.29 x + 7.03 x + 3.05 x + 8.01 x + 9.12 x + 7.88 x + 8.75 x + 9.55 x + 7.88 x + 1.79 x + 
10-5 10-4 10-5 10-° 10-4 107 10-° 10° 1077 10-6 
F51 8.16 x + 3.34 x + 3.34 x - 1.72 x + 3.34 x - 3.34 x - 1.93 x + 2.70 x + 3.34 x - 3.34 x - 
10-? 10-1 10"! 10-? 10"! 10"! 10-? 10-? 10"! 10"! 
F52 3.01 x + 3.02 x + 1.78 x + 3.01 x + 3.02 x + 499 x + 3.02 x + 3.02 x + 4.04 x + 499 x + 
10-11 10-1 10° 10-11 10-1 10°° 10-11 10°" 107! 10°° 
F53 3.02 x + 7.39 x + 8.99 x + 3.02 x + 8.10 x + 3.02 x + 3.32 x + 1.78 x + 1.24 x + 1.17 x + 
10-11 10°" 10" 10°" 10°” 10" 10-6 10°” 10-° 10°? 
D 29 29 28 30 30 30 28 30 29 29 
ND 1 1 2 0 0 0 2 0 1 1 
+ stands for no difference — indicates there is the difference. 


D refers to the number of test functions which contain a difference. 
ND indicates the number of test functions with no difference. 


NOA, L-SHADE, and AL-SHADE is 1,000,000. The other parameters 
of NOA are set as defined before, while those of the CEC2014 
winners are set as recommended in [97,98]. Those algorithms 
were run 30 times independently on the CEC2014 test functions, 
and the results of the analysis of the fitness values in terms of 
Ave and Std are shown in Table 11. Inspecting this table reveals 
that NOA is competitive with AL-SHADE and L-SHADE for 5 test 
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functions, superior for 14 test functions, and inferior for 11 test 
functions. In addition, overall effectiveness is reported in Fig. 17 
which shows the average of the fitness values and Std values 
listed in Table 11. This figure reveals that NOA is the best in terms 
of the average fitness value with 1593, while its performance is 
slightly poor for the average Std value compared to L-SHADE. 
From that, it could be observed that NOA could overcome the 
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Table 6 
Results of unimodal, multimodal, hybrid, and composition CEC-2017 test functions. 

F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 

Unimodal 

_ Ave 1.00 x 10? 3.19 x 10? 149 x 10? 3.52 x 10? 2.10 x 10° 2.52 x 10? 3.28 x 10° 3.69 x 10? 1.40 x 107 3.90 x 10? 6.74 x 10? 
Std 2.75 x 10°° 3.15 x 10? 1.92 x 10? 1.80 x 103 6.21 x 10° 2.41 x 10? 3.28 x 10? 3.25 x 10? 6.39 x 107 3.85 x 10? 4.64 x 10? 
Rank 1 4 2 6 10 3 5 7 a 8 9 

F55 Ave 3.00 x 10? 3.00 x 10? 3.00 x 10? 3.00 x 10? 1.25 x 10? 3.00 x 10? 3.00 x 10? 3.00 x 107 2.22 x 10? 5.70 x 10? 3.00 x 107 
Std 3.17 x 10°" 8.02 x 10-'° 1.24 x 10-8 9.45 x 1074 1.00 x 10? 1.67 x 107'° 2.75 x 10°° 1.19 x 10-7 2.31 x 10? 7.01 x 10? 7.91 x 10-4 
Rank 1 4 2 8 10 3 5 6 12 9 7 

Multimodal 

_ Ave 4.00 x 10? 4.06 x 10° 4.01 x 10° 4.03 x 10° 436 x 10° 4.02 x 10? 4.06 x 107 4.03 x 10° 4.23 x 10? 412 x 10° 4.21 x 10° 
Std 1.20 x 10-5 1.23 x 10! 9.11 x 107! 2.27 x 10° 4.10 x 10! 1.09 x 10° 1.16 x 10! 1.57 x 10° 2.14 x 10! 1.90 x 10! 2.85 x 10! 
Rank 1 6 2 4 11 3 7 5 10 8 9 

§57 Ave 5.05 x 107 5.21 x 10° 5.25 x 10° 5.30 x 10? 5.52 x 10? 5.27 x 10° 5.38 x 10° 5.13 x 10? 5.19 x 10? 5.59 x 10? 5.17 x 10? 
Std 2.21 x 10° 8.98 x 10° 1.06 x 10! 8.56 x 10° 1.94 x 10! 1.10 x 10! 1.74 x 10! 5.89 x 10° 8.64 x 10° 2.16 x 10! 5.59 x 10° 
Rank 1 5 6 8 1 7 9 2 4 12 3 

rg AVE 600.000 609.029 601.412 617.617 629.777 607.177 609.314 600.010 601.180 643.471 600.220 
Std 1.52 x 10-4 6.84 x 10° 1.08 x 10° 7.23 x 10° 1.37 x 10! 4.29 x 10° 1.46 x 10! 7.84 x 10-3 1.23 x 10° 1.02 x 10! 2.63 x 10°? 
Rank 1 7 4 8 11 6 9 2 5 12 3 

HG Ave 7.16 x 107 7.34 x 10° 7.39 x 10° 7.58 x 10? 7.79 x 10° 7.49 x 10° 7.63 x 10° 7.27 x 10° 7.32 x 10° 8.15 x 10? 7.26 x 10° 
Std 3.00 x 10° 1.21 x 10! 156 x 10! 1.48 x 10! 2.41 x 10! 1.69 x 10! 1.66 x 10! 1.06 x 10! 8.35 x 10° 6.78 x 10° 5.67 x 10° 
Rank 1 5 6 8 isl 7 9 3 4 12 2 

F60 Ave 8.05 x 10? 8.22 x 107 8.23 x 107 8.27 x 10? 8.43 x 107 8.25 x 107 8.29 x 107 8.12 x 107 8.13 x 107 8.52 x 10? 8.17 x 107 
Std 2.70 x 10° 8.87 x 10° 8.20 x 10° 5.17 x 10° 1.75 x 10! 8.36 x 10° 1.17 x 10! 4.98 x 10° 5.57 x 10° 1.78 x 10! 7.37 x 10° 
Rank 1 5 6 8 10 7 9 2 3 12 4 

_ Ave 900.000 919.841 910.349 1063.171 1406.620 993.623 1155.089 900.624 922.635 1749.439 900.004 
Std 2.99 x 10-4 5.17 x 10! 1.23 x 10! 9.60 x 10! 3.89 x 10? 7.59 x 10! 1.78 x 107 5.26 x 107! 2.36 x 10! 147 x 10? 8.43 x 10°? 
Rank 1 6 4 9 a 7 10 3 5 12 2 

F62 Ave 1.14 x 10? 1.83 x 10? 1.84 x 10? 1.66 x 10? 2.05 x 10? 1.90 x 10? 1.84 x 10? 1.53 x 10? 1.55 x 10? 2.34 x 10? 1.55 x 10? 
Std 1.03 x 10? 2.92 x 10? 2.97 x 10° 1.97 x 10? 3.52 x 10? 3.15 x 10? 3.70 x 10? 2.24 x 10° 2.44 x 10? 3.26 x 10? 1.96 x 107 
Rank 1 6 8 5 10 9 7 2 4 1 3 

Hybrid 

P63 Ave 1.10 x 10? 2.05 x 10° 1.11 x 103 1.13 x 10° 1.24 x 10? 1.12 x 10? 1.14 x 10? 1.11 x 103 1.37 x 10? 9.61 x 104 1.11 x 103 
Std 1.43 x 10° 5.27 x 107 5.28 x 10° 8.04 x 10° 1.66 x 107 1.42 x 10! 2.63 x 10! 8.34 x 10° 9.10 x 107 158 x 105 7.28 x 10° 
Rank 1 11 3 6 8 5 7 2 10 12 4 

_ Ave 1.23 x 10? 171 x 10° 152 x 104 6.92 x 104 478 x 10° 1.81 x 104 429 x 10° 9.21 x 10? 8.37 x 10° 3.51 x 10° 6.55 x 104 
Std 3.41 x 10! 2.24 x 10° 1.34 x 104 1.00 x 10° 5.38 x 10° 1.54 x 104 481 x 10° 7.43 x 10? 1.52 x 10° 3.97 x 10° 5.73 x 104 
Rank 1 10 3 6 1 4 8 2 9 7 5 

F65 Ave 1.30 x 10? 1.45 x 104 1.82 x 10? 9.12 x 103 1.72 x 104 1.59 x 10? 1.35 x 104 6.72 x 10? 1.09 x 104 1.58 x 104 1.16 x 104 
Std 2.41 x 10° 1.32 x 104 5.44 x 107 452 x 103 1.40 x 104 2.66 x 107 9.18 x 107 5.84 x 10? 6.75 x 10? 141 x 104 1.24 x 104 
Rank 1 9 3 5 isl 2 8 4 6 10 7 

P66 Ave 1.40 x 10? 1.50 x 10? 1.48 x 103 1.95 x 10° 2.45 x 10? 1.46 x 10? 1.99 x 10? 1.46 x 107 3.33 x 10° 466 x 10° 1.50 x 10? 
Std 6.58 x 10°! 3.43 x 10! 3.61 x 10! 5.70 x 10? 1.29 x 10? 2.91 x 10! 7.56 x 10° 2.11 x 10! 1.79 x 10? 3.49 x 10? 2.14 x 10° 
Rank 1 5 4 8 10 2 9 3 11 12 6 

P67 Ave 1.50 x 10? 2.50 x 103 1.57 x 10? 2.04 x 10? 6.26 x 107 156 x 10? 3.48 x 10° 1.57 x 10? 4.68 x 10? 1.48 x 104 1.94 x 10? 
Std 477 x 107! 7.37 x 10° 455 x 10! 6.43 x 10? 415 x 10° 5.72 x 10! 1.29 x 10° 435 x 10! 3.66 x 10° 1.15 x 104 8.55 x 10° 
Rank 1 8 3 6 1 2 9 4 10 12 5 

Poe Ave 1.61 x 10° 1.72 x 10? 1.75 x 103 1.79 x 10° 1.88 x 10° 1.69 x 10? 1.78 x 10° 1.68 x 107 1.79 x 10? 2.16 x 10? 1.70 x 103 
Std 3.00 x 10! 1.07 x 10? 1.15 x 10? 1.27 x 10? 1.18 x 10? 9.93 x 10! 1.33 x 10? 7.81 x 10! 1.43 x 10? 2.09 x 10? 6.94 x 10! 
Rank 1 6 7 9 1 3 8 2 10 12 4 

P69 Ave 1.70 x 10? 1.78 x 10? 1.75 x 10? 1.76 x 103 1.81 x 10? 1.75 x 10? 1.76 x 10? 1.74 x 103 1.76 x 10? 1.91 x 103 1.76 x 10? 
Std 9.27 x 10°! 4.08 x 10! 3.66 x 10! 1.44 x 10! 484 x 10! 1.70 x 10! 3.55 x 10! 1.67 x 10! 3.60 x 10! 158 x 10? 4.27 x 10! 
Rank 1 9 4 6 1 3 8 2 5 12 7 

F70 Ave 1.80 x 10? 1.23 x 104 3.71 x 103 1.63 x 104 1.75 x 104 2.63 x 10? 2.03 x 104 1.39 x 104 2.46 x 104 1.72 x 104 2.70 x 104 
Std 2.74 x 107! 9.40 x 103 3.31 x 10? 1.03 x 104 1.38 x 104 1.61 x 10? 1.16 x 104 1.25 x 104 1.40 x 104 1.13 x 104 1.60 x 104 
Rank 1 4 3 6 8 2 9 5 10 7 a 

_ Ave 1.90 x 10° 2.26 x 10° 1.98 x 10? 7.50 x 10? 749 x 104 1.96 x 10? 5.56 x 10? 1.95 x 10? 1.56 x 104 8.27 x 10? 6.16 x 10? 
Std 3.08 x 10°? 5.61 x 10° 6.74 x 10! 6.29 x 10? 1.78 x 10° 5.35 x 10! 468 x 10° 3.42 x 10! 413 x 104 6.22 x 10? 6.44 x 10? 
Rank 1 5 4 9 12 3 7 2 a 10 8 

F72 Ave 2.00 x 10° 2.10 x 103 2.08 x 10? 2.12 x 10? 2.17 x 10? 2.07 x 10? 2.11 x 10? 2.06 x 10? 2.08 x 10? 2.25 x 10? 2.03 x 10? 
Std 2.31 x 10° 6.35 x 10! 5.69 x 10! 5.83 x 10! 5.93 x 10! 4.68 x 10! 6.05 x 10! 5.70 x 10! 5.44 x 10! 1.03 x 107 2.67 x 10! 
Rank 1 8 5 10 11 4 9 3 6 12 2 


CEC2014 winners for the majority of the CEC2014 test functions. 
Hence, it could be classified as a highly-performing optimizer. 


5.9. Comparison with CEC2017 winners 


This new section compares our suggested NOA’s performance 
to that of the CEC2017 winners, LSHADE-SPACMA and LSHADE- 
cnEpSin. The experiments conducted here were based on a popu- 
lation size of 200 for the proposed NOA, and a total of 1,000,000 
function evaluations for NOA, LSHADE-SPACMA and LSHADE- 
cnEpSin. The other NOA parameters are set as previously defined, 
while the CEC2017 winners’ parameters are set as suggested 
in [92,99]. The results of the analysis of the fitness values in terms 
of Ave and Std are displayed in Table 12 after those algorithms 
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(continued on next page) 


were applied 30 times independently to the CEC2017 test func- 
tions. Looking at this table reveals that NOA is superior for 18 
test functions, inferior for four test functions, and competitive 
LSHADE-SPACMA and LSHADE-cnEpSin for 7 test functions. Addi- 
tionally, Fig. 18 (which displays the average of the fitness values 
and Std values listed in Table 11) reports overall effectiveness. 
This figure shows that NOA is the best in terms of average fitness 
value with 1677, but that it performs slightly worse than LSHADE- 
SPACMA for average Std value. This affirms our conclusion that 
NOA could be categorized as a highly-performing optimizer. 


6. Real-world optimization problems 


This section talks about the experiments that were done to 
see how well the NOA worked with five engineering problems: 
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F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 

Composition 

F73 Ave 2.25 x 10? 2.28 x 10? 2.27 x 10? 2.22 x 10? 2.31 x 103 2.22 x 10? 2.26 x 10? 2.30 x 10? 2.30 x 10? 2.35 x 10? 2.30 x 107 
Std 5.43 x 10! 5.82 x 10! 6.27 x 10! 4.49 x 10! 6.99 x 10! 4.51 x 10! 6.79 x 10! 3.47 x 10! 3.46 x 10! 437 x 10! 491 x 10! 
Rank 4 7 6 2 11 1 5 9 10 12 8 

al Ave 2.27 x 10° 2.30 x 10? 2.30 x 10? 2.31 x 10? 2.44 x 10° 2.30 x 10? 2.31 x 10° 2.30 x 10? 2.31 x 10? 2.38 x 10? 2.34 x 10? 
Std 449 x 10! 2.31 x 10! 1.26 x 10° 5.13 x 10° 3.58 x 10? 1.24 x 10! 9.07 x 10° 1.13 x 10! 1.97 x 10! 9.00 x 10! 1.69 x 107 
Rank 1 2 4 7 12 5 6 3 8 11 9 

F75 Ave 2.61 x 10° 2.62 x 10? 2.63 x 107 2.62 x 10? 2.65 x 103 2.63 x 10? 2.64 x 103 2.61 x 10? 2.62 x 10? 2.72 x 103 2.62 x 10? 
Std 3.21 x 10° 9.22 x 10° 1.35 x 10! 1.07 x 10! 2.73 x 10! 1.39 x 10! 1.76 x 10! 486 x 10° 9.09 x 10° 4.07 x 10! 5.69 x 10° 
Rank 1 5 8 6 10 7 9 2 3 12 4 

F76 Ave 2.62 x 10° 2.74 x 10? 2.73 x 10° 2.75 x 10? 2.78 x 10° 2.74 x 10° 2.78 x 10° 2.74 x 10? 2.75 x 10? 2.81 x 10? 2.76 x 10? 
Std 1.19 x 107 461 x 10! 7.98 x 10! 7.63 x 10° 2.72 x 10! 6.47 x 10! 2.33 x 10! 5.54 x 10° 1.09 x 10! 1.31 x 10? 1.05 x 10! 
Rank 1 4 2 6 10 3 9 5 7 12 8 

_ Ave 2914.927 2919.836 2917.628 2924.635 2952.137 2916.308 2925.348 2926.734 2932.432 2946.625 2931.421 
Std 2.30 x 10! 2.34 x 10! 2.28 x 10! 2.41 x 10! 6.15 x 10! 2.41 x 10! 3.54 x 10! 2.00 x 10! 1.61 x 10! 6.92 x 10! 2.64 x 10! 
Rank 1 4 9 2 10 3 11 8 7 5 6 

ea Ave 2.85 x 10° 2.97 x 10? 3.05 x 10? 3.02 x 10? 3.60 x 10? 2.96 x 10° 3.08 x 10? 3.03 x 10? 3.09 x 10? 3.81 x 10? 3.30 x 10? 
Std 1.04 x 107 2.81 x 107 2.60 x 107 2.56 x 107 6.43 x 107 1.41 x 10? 2.99 x 107 2.95 x 10? 3.30 x 10? 5.08 x 107 5.00 x 107 
Rank 1 3 6 4 11 2 7 5 9 12 10 

a Ave 3.09 x 10? 3.09 x 10? 3.10 x 10? 3.09 x 10? 3.14 x 10? 3.10 x 10? 3.10 x 10? 3.09 x 10? 3.10 x 10? 3.19 x 10? 3.09 x 10° 
Std 2.20 x 10° 2.91 x 10° 1.84 x 10! 2.22 x 10° 4.02 x 10! 8.44 x 10° 1.18 x 10! 3.09 x 10° 1.28 x 10! 432 x 10! 1.69 x 10° 
Rank 2 3 10 5 11 6 8 4 7 12 1 

Fao Ave 3.12 x 10? 3.28 x 10? 3.33 x 10? 3.34 x 10? 3.40 x 10? 3.31 x 10? 3.31 x 10? 3.35 x 10? 3.40 x 10? 3.39 x 10? 3.30 x 10? 
Std 7.91 x 10! 1.87 x 10? 1.30 x 10? 1.27 x 10? 2.02 x 107 1.39 x 10? 1.36 x 107 1.14 x 10? 1.10 x 10? 1.22 x 10? 1.48 x 10? 
Rank 1 2 7 8 12 6 5 9 11 10 4 

Fat Ave 3.14 x 10° 3.19 x 10? 3.24 x 10? 3.19 x 10? 3.33 x 10? 3.23 x 10? 3.27 x 10? 3.18 x 10? 3.20 x 10? 3.49 x 10? 3.22 x 10? 
Std 8.16 x 10° 5.28 x 10! 5.78 x 10! 3.08 x 10! 9.27 x 10! 6.50 x 10! 7.01 x 10! 3.18 x 10! 483 x 10! 1.53 x 107 7.02 x 10! 
Rank 1 3 9 4 11 8 10 2 5 12 6 

Fa? Ave 3.47 x 10° 2.38 x 10° 3.88 x 10° 1.06 x 10° 9.61 x 10° 2.02 x 10° 1.77 x 10° 3.94 x 10° 6.04 x 10° 1.86 x 10° 1.70 x 10° 
Std 8.74 x 10! 451 x 10° 5.70 x 10° 1.62 x 10° 1.13 x 10° 3.08 x 10° 2.61 x 10° 5.29 x 10° 7.52 x 10° 2.20 x 10° 3.79 x 10° 
Rank 1 5 6 2 10 12 4 7 8 11 3 

Ave. Rank 1.14 5.57 5.00 6.39 10.61 4,39 7.93 3.86 7.61 10.71 5.61 
Ave. Std 2.44 x 10! 9.38 x 104 2.04 x 104 9.90 x 10? 446 x 10° 1.07 x 10° 2.67 x 104 1.93 x 104 2.28 x 10° 9.68 x 104 1.65 x 104 


Bold values indicate the best findings. 
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Fig. 17. Comparison among L-SHADE, AL-SHADE, and NOA using CEC2014. 


a welded beam, a tension/compression spring, a pressure vessel, 
a 3-bar truss, and a 10-bar truss. It is not easy to solve these 
kinds of problems due to finding some constraints which have 
to be handled. There are a variety of penalty methods that can be 
used to deal with these constraints, some of the more common 
ones are static, dynamic, annealing, adaptive, co-evolutionary, 
and death penalty [101]. With NOA and rival optimizers, the 
death penalty is used to give the unfeasible solutions an objec- 
tive value high enough to be discarded during the optimization 
process if minimization is desired. 


6.1. The welded beam design problem 


In this section, NOA’s performance is evaluated using the 
welded bean design (WBD) problem depicted in Fig. 19 (a). To 
minimize the total fabrication cost of a welded beam, it is nec- 
essary to determine the optimal values for four design variables 
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(h, |, t, and b) to satisfy seven constraints, including tip detection, 
weld coverage, bending stress, buckling load, and cost. Following 
is a description of the WBD problem’s mathematical model: 


- Solutions to this problem are represented as follows: 
X = [x X2 X3 x4] =[h lt b] 
- The objective function employed along with the optimiza- 
tion algorithm to handle this problem is as: 
f (X) = 1.1047 1x}x2 + 0.048 11x3x4(14.0 + x2) 


- The mathematical formulation of the constraints of this 
problem: 


&1 (X) = T (X) — Tmax < 0 
&2 (X) =O (X) — Omax < 0 
§3 (Xx) =6 (X) — dmax < 0 
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Table 7 
P-values on CEC-2017 test suite (F54-F82). 
Fun SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
F54 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1! 10-11 10-1 10-1! 10-11 10-1 10-1! 10-1! 10-1 
F55 1.72 x + 9.24 x + 172 x + 1.72 x + 1.80 x + 172 x + 1.80 x + 172 x + 172 x + 172 x + 
10-12 10-12 10-12 10-12 10-12 10-2 10-12 10-12 10-2 10-12 
F56 3.02 x + 2.37 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10710 1071! 10-1! 10-1! 107-1! 10-1! 10-1 10-1! 1071! 
F57 1.29 x + 3.58 x - 2.94 x - 2.94 x + 3.59 x + 2.93 x - 4.09 x + 173 x + 2.94 x + 9.52 x + 
10719 10-1 107-1! 10-1! 10-1 10-1! 10710 10710 10-1! 10710 
F58 211 x + 2411 x - 2.11 x + 211 x + 211 x + 2.11 x - 2.04 x + 211 x + 2.11 x + 2.11 x + 
10-1 10-1! 10-1! 10-"! 10-1 10-1! 10-6 10-"! 10-1 10-"! 
F59 8.10 x + 3.34 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 1.07 x + 5.49 x + 3.02 x + 141 x + 
1o-'° 10-1! 10-1! to“! 10°" 10-1! 10-7 1o-" Jo“! 10-° 
FGO 1.04 x + 1.04 x + 2.87 x + 2.87 x + 3.88 x + 3.51 x + 3.03 x - 1.94 x + 2.87 x + 6.31 x + 
10-9 10-1° Jo“! to“! 10-1! 1o-!! 10-7 10-8 Jo“! 10-8 
F61 1.21 x + 1.20 x + 1.21 x + 1.21 x + 121 x + 1.21 x + 1.64 x + 1.21 x + 1.21 x + 1.21 x + 
10-12 10-12 10-12 10-12 10-12 10-12 10-10 10-12 10-12 10-12 
F62 7.39 x + 1.33 x + 3.69 x + 6.07 x + 669 x + 3.69 x + 155 x + 186 x + 3.02 x + 5.49 x + 
10-"! 10-1 10“! 10-"! 10-"! 10-1 10-° 10-9 10-1 10-1! 
F63 3.02 x + 146 x + 3.02 x + 3.02 x + 4.98 x + 3.69 x + 3.35 x + 3.02 x + 3.02 x + 4.98 x + 
Jo“! 10-'° 10-1! too"! 10-1! 10-1! 10-8 10-1! Jo“! to“! 
F64 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1 10-1! 10-1! 10-1 10-1! 10-1! 10-1 10-1! 10-11 
F65 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1! 10-11 10-1 10-1! 10-1! 10-1 10-1! 10-1! 10-1 
FG6 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1! 10-11 10-1 10-1! 10-1! 10-1 10-1! 10-11 10-1! 
FG7 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
107-1! 10-1 10-1! 10-11 10-1! 10-11 10-1! 10-1 107-11 10-1! 
F68 7.39 x + 5.07 x + 5.49 x + 4.98 x + 2.15 x + 6.07 x + 215 x + 1.21 x + 3.02 x + 1.33 x + 
10-11 10710 10-1! 10-1! 10710 10-1! 10719 10710 10-1! 10710 
F69 3.02 x + 9.92 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 4.08 x + 3.02 x + 462 x + 
10-1! 10-1! 10-1! 10-1 10-11 10-1! 10-1 10-1! 10-1! 10-10 
F70 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1! 10-1 10-1 10-1! 10-1 10-1 10-1! 10-1! 10-1 
F71 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 10-1 10-1! 10-1! 10-1! 10-1! 10-1! 10-1 10-1! 10-1! 
F72 2.62 x + 2.89 x + 2.62 x + 2.62 x + 2.62 x + 2.62 x + 2.62 x + 2.62 x + 2.62 x + 2.62 x + 
10-1! 10-1 10-1! 10-1! 10-1! 10-1! 10-11 10-1 10-11 10-1! 
F73 1.34 x + 1.60 x + 2.09 x + 1.10 x + 159 x + 142 x + 8.95 x + 8.62 x + 651 x + 1.29 x + 
10-5 10-4 10-3 10-6 10-2 10-4 10-8 10519 10-10 10-8 
F74 159 x + 119 x + 2.98 x + 1.84 x + 131 x + 2.98 x + 1.78 x + 9.80 x + 2.98 x + 142 x + 
10-18 10-1 10-1! 10-9 10-10 1051) 10-4 10-"! 10-1 10-8 
F75 1.85 x + 5.57 x + 3.47 x + 7.39 x + 457 x + 3.02 x + 149 x + 2.57 x + 3.02 x + 5.57 x + 
1o-® 10-"° 10-10 10-1! 107° 10-1! 10-6 10-7 Jo“! 1o-'° 
F76 1.04 x + 9.92 x + 1.26 x + 3.43 x + 5.29 x + 7.19 x + 7.64 x + 4.90 x + 2.63 x + 8.70 x + 
10-9 10-9 10-° 10-9 10-6 10-10 10-° 10-° 10-1 10-1! 
F77 5.26 x + 6.26 x + 5.83 x + 1.36 x + 185 x + 7.00 x + 437 x + 1.94 x + 1.25 x + 2.48 x + 
10-3 10-4 10-5 10-8 10-4 10-6 10-4 10-> 10-8 10-4 
F78 2.98 x + 9.64 x + 431 x + 1.96 x + 454 x + 7.89 x + 761 x + 1.96 x + 2.60 x + 2.60 x + 
1o-° 1077 10°? 1o-"! 1077 10-5 10-° 10-1! 10-10 10-10 
F79 3.51 x + 8.25 x + 9.50 x + 447 x + 2.38 x + 5.06 x + 145 x + 671 x + 3.00 x + 8.10 x + 
10-7 10-6 10-4 to"! 10-4 10-8 107! 10-6 Jo“! 10-4 
F80 5.12 x + 8.29 x + 2.59 x + 5.24 x + 112 x + 1.83 x + 1.85 x + 8.09 x + 3.77 x + 1.94 x + 
10-3 10-3 10-6 10-8 10-4 10-5 10-4 10-6 10-> 10-6 
F81 444 x + 6.70 x + 2.57 x + 498 x + 147 x + 2.37 x + 7.60 x + 141 x + 3.02 x + 3.57 x + 
10-7 10-"! 10-7 10-"! 1077 10-10 10-7 10-9 10-"! 10-6 
F82 3.02 x + 3.34 x + 3.02 x + 3.02 x + 4.96 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-1! 10-1 10-1! 10-11 10-1! 10-1! 10-1! 10-1 10-11 10-11 
D 29 26 27 29 28 27 29 29 29 29 
ND ) 3 2 ft) 1 2 ) 0 0 0 
+ stands for no difference — indicates there is the difference. 


D refers to the number of the test functions which contain a difference. 
ND indicates the number of test functions with no difference. 


84 (X) =X, —X4 <0 
85 (X) = P— P(X) < 0 


g (X) = 1.1047 1x2 + 0.04811x3x4(14.0 + x2) — 5.0 < 0 


Where 


x2 
X 2 4.2t't” Ny2 
t (X) = ,/(t’) Maer (t”) 
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Table 8 
Results of unimodal, multimodal, hybrid, and composition CEC-2020 test functions. 
F Index NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
Unimodal 
res Ave 1.00 x 10° 2.19 x 10? 2.10 x 10? 2.90 x 10? 3.05 x 10° 2.12 x 10° 3.75 x 10? 3.19 x 10? 4.89 x 107 3.61 x 10° 7.44 x 10? 
Std 2.17 x 10° 258 x 10° 2.29 x 10? 1.13 x 103 7.30 x 10° 2.22 x 10° 3.45 x 10? 2.86 x 10? 1.40 x 108 3.16 x 10° 437 x 10° 
Rank 1 4 2 5 10 3 8 6 11 7 9 
Multimodal 
Fad Ave 1.23 x 10? 1.81 x 10° 1.90 x 10? 1.55 x 10? 2.12 x 10? 1.93 x 10? 1.91 x 10? 1.52 x 103 1.54 x 10? 2.45 x 10? 1.64 x 10? 
Std 9.56 x 10! 2.84 x 10? 3.00 x 10? 2.26 x 10° 3.39 x 10? 2.51 x 10° 3.30 x 10? 2.11 x 10? 1.94 x 107 417 x 10? 1.85 x 107 
Rank 1 6 Yi, 4 10 9 8 2 3 12 5 
Hybrid 
Bae Ave 7.16 x 107 7.32 x 10° 7.38 x 10° 7.61 x 10° 7.78 x 10? 748 x 10° 7.59 x 10° 7.21 x 10? 7.30 x 10° 8.14 x 10? 7.27 x 10° 
Std 2.84 x 10° 9.69 x 10° 117 x 10! 1.62 x 10! 2.11 x 10! 1.61 x 10! 1.69 x 10! 448 x 10° 8.20 x 10° 6.00 x 10° 8.58 x 10° 
Rank 1 5 6 9 11 7 8 2 4 12 3 
_ Ave 1900.000 1901.608 1900.000 1900.000 1900.050 1900.000 1900.000 1900.000 1900.373 1900.000 1900.000 
Std 0.00 x 10° 7.24 x 107! 0.00 x 10° 0.00 x 10° 199 x 1071 0.00 x 10° 0.00 x 10° 0.00 x 10° 5.44 x 107! 0.00 x 10° 0.00 x 10° 
Rank 1 5 1 1 2 1 1 1 3 1 1 
FR7 Ave 1.71 x 10? 5.88 x 10? 2.41 x 10? 1.16 x 104 3.40 x 10° 2.23 x 103 8.49 x 10? 3.90 x 10? 5.24 x 104 2.88 x 104 7.82 x 10? 
Std 1.01 x 10! 3.38 x 10? 3.68 x 10? 2.85 x 104 6.45 x 10° 3.24 x 10? 472 x 10? 1.83 x 103 1.22 x 10° 6.18 x 104 5.48 x 10? 
Rank 1 5 3 8 12 2 7 4 11 10 6 
faa Ave 1.60 x 10? 172 x 10? 1.73 x 10° 1.72 x 10? 1.86 x 10? 176 x 10° 1.77 x 10? 1.69 x 10° 1.75 x 10? 2.03 x 10? 1.71 x 103 
Std 3.41 x 10° 7.76 x 10! 8.15 x 10! 8.40 x 10! 1.04 x 10? 8.58 x 10! 1.09 x 10? 8.49 x 10! 1.10 x 107 2.18 x 10? 8.99 x 10! 
Rank 1 5 6 4 11 8 9 2 7 12 3 
Fag Ave 2.10 x 10? 6.82 x 10? 2.45 x 103 447 x 10? 5.52 x 104 2.41 x 103 8.01 x 107 2.34 x 10? 1.03 x 104 8.45 x 10? 4.09 x 10? 
Std 3.06 x 10° 4.46 x 10° 2.72 x 10? 2.15 x 10? 5.44 x 104 1.89 x 107 6.33 x 10? 1.42 x 10° 4.62 x 10° 6.50 x 10? 3.79 x 10? 
Rank 1 7. 4 6 12 3 8 2 11 9 5 
Composition 
_ Ave 2.27 x 10? 2.32 x 10? 2.30 x 10? 2.30 x 10? 2.32 x 10? 2.31 x 10° 2.30 x 10? 2.31 x 10? 2.36 x 10° 2.39 x 10? 2.35 x 10? 
Std 448 x 10! 1.40 x 10? 7.68 x 10° 1.29 x 10! 2.17 x 10! 3.51 x 10° 1.65 x 10! 7.74 x 10! 1.61 x 10? 2.17 x 107 2.15 x 107 
Rank 1 8 2 4 7 5 3 6 11 12 9 
£91 Ave 2.59 x 10° 2.74 x 10? 2.72 x 103 2.75 x 10? 2.76 x 10? 2.69 x 103 2.74 x 10? 2.74 x 10? 2.74 x 103 2.86 x 10? 2.75 x 103 
Std 1.14 x 10? 461 x 10! 8.84 x 10! 9.96 x 10° 6.95 x 10! 1.16 x 107 9.68 x 10! 478 x 10° 1.14 x 10! 5.65 x 10! 4.77 x 10! 
Rank 1 4 3 9 10 2 5 6 7 12 8 
F92 Ave 2.92 x 10? 2.93 x 103 2.93 x 103 2.92 x 103 2.95 x 10? 2.93 x 103 2.94 x 103 2.93 x 10? 2.94 x 103 2.95 x 103 2.93 x 10? 
Std 2.24 x 101 2.39 x 10! 5.43 x 10! 2.50 x 10! 6.73 x 10! 2.49 x 10! 2.92 x 10! 2.15 x 10! 1.70 x 10! 3.44 x 10! 3.25 x 10! 
Rank 1 4 7 2 10 3 8 5 9 11 6 
Ave Rank 1.00 6.11 4.05 5.58 9.68 479 6.95 437 8.47 10.37 6.21 
Ave Std 2.82 x 10! 1.05 x 10? 3.31 x 10? 3.06 x 10° 7.62 x 10° 3.08 x 10? 1.44 x 10? 4.99 x 10° 1.33 x 107 6.90 x 10? 1.35 x 103 
Bold values indicate the best findings. 
Table 9 
P-values on CEC-2020 test suite (F83-F92). 
Fun SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
F83 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 10-1 10-1 10-11 40-1 40-11 ol 40-11 10-11 ou 
F84 1.09 x + 2.67 x + 1.01 x + 9.92 x + 2.61 x + 3.02 x + 1.73 x + 2.67 x + 3.02 x + 1.31 x + 
10-1 10-° 10-* qo 10-1 10" 10-4 10-° 10-1 10-* 
F85 3.02 x + 6.07 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 1.61 x + 5.07 x + 3.02 x + 2.03 x + 
10-11 10-1" 10-1 10-1 10°" 10" 10-6 10-1 10-1 10°° 
F86 1.21 x + NaN + NaN - 8.15 x + NaN + NaN + NaN + 5.85 x + NaN + NaN + 
10°” 10-© 10° 
F87 3.02 x - 3.34 x - 3.02 x + 3.02 x + 4.50 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 40-1 10-1 10-1 10-1 10-1 10-11 qo-1 10-1 10-1 
F838 3.69 x + 4.08 x + 4.50 x + 3.69 x + 5.49 x + 498 x + 8.99 x + 3.02 x + 3.02 x + 3.69 x + 
10-11 10-1 10-1 10-11 qo-1 10-1 10-1 10-1 10-1 10-1 
F89 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.34 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 3.02 x + 
10-11 40-11 40-11 10-11 40-11 40-11 ou 40-1 10-11 ou 
F90 2.14 x + 1.69 x + 1.95 x + 3.00 x + 3.00 x + 6.66 x + 1.78 x + 5.54 x + 6.49 x + 1.06 x + 
10-1” 10° 10-1 10-1 10°" 10" 10-4 10°” 10-° 10°° 
FO1 8.95 x + 2.53 x + 8.95 x + 1.30 x + 2.48 x + 8.95 x + 413 x + 2.72 x + 8.95 x + 8.85 x + 
10-1 10° 10-° 10° 10-8 10-° 10-* 10~’ 10-” to 
F92 8.12 x + 2.42 x + 1.44 x - 479 x + 3.61 x + 1.42 x + 4.28 x + 1.80 x + 412 x + 3.58 x + 
10-3 10-3 10"! 10-7 10-4 10+ 10-4 10°? 10-5 10-6 
D 10 9 8 10 9 9 9 9 9 
ND 0 1 2 0 1 1 1 1 1 
+ stands for no difference — indicates there is difference. 


D refers to the number of the test functions which contain a difference. 
ND indicates the number of test functions with no difference. 


2LV 4G 
P = 6000, L = 14, E = 30 x 10°,G = 12 x 10°, 
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Tmax = 13600, Omax = 30000, dingy = 0.25 


Table 13 presents the results obtained by NOA and these of 
10 optimizers on this problem, which demonstrates that NOA 
is superior to all optimizers in terms of average fitness value 
(Ave), Std, Rank, and p-value, and competitive in terms of the 
best fitness value. A further illustration is provided in Fig. 19(b), 
which depicts the convergence speed obtained by the proposed 
algorithm on the WBD problem; this figure shows that NOA has a 
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Table 10 
Overall effectiveness of the proposed NOA. 
F ndex NOA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
Standard Rank 2.13 487 2.22 2.52 3.70 1.35 1.30 3.13 4.43 3.61 2.09 
Std 190.46 133.12 50.68 78.53 1335.05 0.00 3.64 25.99 31.02 7.31 0.06 
Oe (%) 73.91 21.74 69.57 65.22 52.17 82.61 78.26 43.48 34.78 47.83 60.87 
Cec2014 Rank 1.52 6.21 4.48 6.24 9.97 5.62 7.14 4.38 8.07 9.17 4.90 
: Std 1.3 x 10! 2.7 x 104 2.4 x 104 47 x 10? 2.1 x 10° 2.0 x 104 4.9 x 103 2.3 x 104 2.3 x 108 1.4 x 10° 3.1 x 10? 
Oe (%) 83.33 0.00 3.33 3.33 0.00 0.00 0.00 6.67 0.00 3.33 0.00 
CeC2017 Rank 1.14 5.57 5.00 6.39 10.61 4.39 7.93 3.86 7.61 10.71 5.61 
Std 2.4 x 10! 9.3 x 104 2.0 x 104 9.9 x 10? 4.4 x 10° 1.0 x 10° 2.6 x 104 1.9 x 104 2.2 x 10° 9.6 x 104 1.6 x 104 
Oe (%) 86.67 0.00 0.00 0.00 0.00 3.33 0.00 0.00 0.00 0.00 3.33 
CeC2020 Rank 1.00 6.11 4.05 5.58 9.68 4.79 6.95 4.37 8.47 10.37 6.21 
Std 2.8 x 10! 1.0 x 10? 3.3 x 10? 3.0 x 10? 7.6 x 10° 3.0 x 10? 14 x 10? 49 x 10? 1.3 x 107 6.9 x 10? 1.3 x 10° 
Oe (%) 100.00 0.00 6.67 6.67 0.00 6.67 6.67 6.67 0.00 6.67 6.67 
Ave. Rank: 1.4475 5.6900 3.9375 5.1825 8.4900 4.0375 5.8300 3.9350 7.1450 8.4650 4.7025 
Ave. Std: 6.4 x 10! 3.0 x 104 1.1 x 104 44 x 10? 3.5 x 10° 3.1 x 104 8.2 x 10? 1.0 x 104 44 x 10° 6.1 x 104 5.2 x 10? 
Ave.Oe (%): 85.98 5.44 19.89 18.81 13.04 23.15 21.23 14.21 8.70 14.46 17.72 f 
Bold values indicates the best outcomes. 
Table 11 
Comparison among NOA and CEC2014 winners. 
F Index NOA AL-SHADE L-SHADE F Index NOA AL-SHADE L-SHADE 
F24 Ave 100 100 100 F39 Ave 1600.44932 1600.30747 1600.67692 
Std 0 0 0 Std 0.30035 0.16971 0.25434 
F25 Ave 200 200 200 F40 Ave 1700.00969 1700.51814 1700.42418 
Std 0 0 0 Std 0.04369 0.56960 0.47000 
F26 Ave 300 300 300 F41 Ave 1800.00124 1800.01463 1800.01068 
Std 0 0 0 Std 0.00093 0.02673 0.03965 
F27 Ave 402.31545 432.60610 425.79456 F42 Ave 1900.01823 1900.01589 1900.00065 
Std 6.43051 8.29363 15.18790 Std 0.01273 0.01287 0.00355 
F28 Ave 513.32592 508.64706 505.10388 F43 Ave 2000.00185 2000.06649 2000.01095 
Std 9.58395 10.05783 8.42065 Std 0.00461 0.12697 0.02398 
F29 Ave 600 600 600 F44 Ave 2100.00030 2100.20595 2100.02677 
Std 0 0 0 Std 0.00024 0.20761 0.09343 
F30 Ave 700.00238 700.00164 700.00025 F45 Ave 2200.09381 2200.00244 2200.00143 
Std 0.00412 0.00503 0.00135 Std 0.14899 0.00438 0.00228 
F31 Ave 800 800 800 F46 Ave 2500 2629.45747 2629.45747 
Std 0 0 0 Std 0 0.00000 0.00000 
F32 Ave 900.83014 901.12762 900.79808 F47 Ave 2501.39420 2504.82607 2502.48032 
Std 0.81477 1.40060 0.67135 Std 2.58383 3.61669 2.95969 
F33 Ave 1000 1000 1000.00208 F48 Ave 2604.30097 2627.83465 2606.39256 
Std 0 0 0.01140 Std 5.61332 44.56134 18.66491 
F34 Ave 1179.57625 1109.64066 1114.30168 F49 Ave 2700.03609 2700.02398 2700.04195 
Std 81.00588 8.95484 12.71759 Std 0.00855 0.00776 0.01452 
F35 Ave 1200.000 1200.00170 1200.02985 F50 Ave 2707.40183 274744644 2724.34286 
Std 1.E—07 0.00776 0.00947 Std 36.37667 122.15005 89.51233 
F36 Ave 1300.03648 1300.02501 1300.03529 F51 Ave 3000 3186.91015 3196.15966 
Std 0.01049 0.00937 0.01114 Std 0 37.96491 49.59883 
F37 Ave 1400.03632 1400.03871 1400.06008 F52 Ave 3000 3121.99881 3121.98497 
Std 0.01313 0.00980 0.01647 Std 0 0.43931 0.46143 
F38 Ave 1500.42469 1500.30238 1500.32914 F53 Ave 3389.59324 3463.71280 3465.05059 
Std 0.11235 0.06007 0.05471 Std 78.87741 7.10066 9.39030 


Bold values indicates the best outcomes. 


high convergence speed in the right direction of the near-optimal 
solution. 


6.2. Tension/compression spring design problem 


Fig. 20(a) shows a tension/compression spring, and the goal 
of this problem is to reduce its weight [102-104]. Constraints, 
such as shear stress, surge frequency, and deflection must be met 
by the optimum design. Design variables include the mean coil 
diameter (D), wire diameter (d), and the number of active coils 
(N) that must be accurately estimated to achieve the best possible 
design. The mathematical model of this problem is as follows: 
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- Solutions to this problem are represented as follows: 

X= [x x2 x3| =[d D N] 

- The objective function employed along with the optimization 
algorithm to handle this problem is as: 

Minimize f (X) = (x3 + 2) xox} 


- Subject to the following constraints: 
3 


X5X 
gi(x)=1-—2-_ < 
71785x4 
Ax2 — x4x 1 
& (X) = a <0 


12566 (xox? — x7) 5.108x7 — 
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F Index NOA LSHADE-SPACMA LSHADE-cnEpSin F Index NOA LSHADE-SPACMA LSHADE-cnEpSin 
F54—s Ave 100 100 100 F69 Ave 1.70049 x 10? 1.70005 x 10? 1.70008 x 10? 
Std 0 0 0 Std 5.94648 x 107! 9.81856 x 10-7 1.01036 x 107! 
F55 ~—s Ave 300 300 300 F70~— Ave 1.80000 x 10? 1.80430 x 103 1.80234 x 103 
Std 0 0 0 Std 3.15192 x 10-4 8.40591 x 10° 6.38288 x 10° 
F56~—s Ave 400 400 400 F71—s Ave 1.90000 x 10? 1.90007 x 103 1.90015 x 103 
Std 0 0 i) Std 1.82605 x 10° = 5.09233 x 10-7 4.73689 x 107! 
F57.—s Ave 5.00895 x 10? 5.01193 x 102 5.01293 x 102 F72— Ave 2000 2.00628 x 103 2.00009 x 103 
Std 7.55030 x 10-1 — 6.29267 x 107! 6.71546 x 107! Std 0 9.61098 x 10° 1.50794 x 107! 
F58 = Ave 600 600 600 F73. Ave 2.19667 x 10° 2.20000 x 103 2.25147 x 103 
Std 0 0 i) Std 1.82574 x 10! 3.03165 x 107 ~—- 5.42618 x 10! 
F59~—s Ave 7.10958 x 10? 7.10997 x 102 7.11484 x 10? F74.—s Ave 2200 2.30003 x 103 2.30000 x 103 
Std 4.45408 x 107! 3.63872 x 1071 2.76966 x 107! Std i) 9.05603 x 10-? 2.14370 x 10-3 
F60 = Ave 8.00895 x 10? 8.00795 x 10? 8.01794 x 102 F75. Ave 2.60052 x 10° 2.60113 x 103 2.60055 x 103 
Std 9.18237 x 107! — 6.29267 x 1071 7.81368 x 107! Std 1.19591 x 10° 1.45951 x 10° 1.15288 x 10° 
F61—s Ave 900 900 900 F76 Ave 2500 2.70693 x 103 2.68309 x 103 
Std 0 0 0 Std 8.44445 x 10°" ~— 7.27150 x 10! 9.65095 x 10! 
F62. Ave 1.01866 x 103 1.00762 x 10° 1.01732 x 103 F77_—s Ave 2.89774 x 10° 2.92522 x 103 2.92561 x 103 
Std 3.07842 x 10! 6.43158 x 10° 3.70358 x 10! Std i) 2.34039 x 10! 2.34325 x 10! 
F63. Ave 1100 1100 1100 F78 Ave 2.73333 x 10° 2.90000 x 103 2.90000 x 103 
Std 0 0 0 Std 1.32179 x 10? 0.00000 x 10° 0 
F64—s Ave 1.20285 x 10? 1.32160 x 103 1.30166 x 10° F79—s Ave 3.08783 x 10° 3.08952 x 10? 3.08909 x 10? 
Std 2.01085 x 10° 7.71133 x 10! 5.40511 x 10! Std 1.13544 x 10° 4.79346 x 10-13 1.59582 x 10° 
F65 ~—s Ave 1.30049 x 10? 1.30297 x 103 1.30339 x 103 F80— Ave 3.06000 x 10? 3.10000 x 103 3.11698 x 10? 
Std 4.98054 x 10-1 —- 2.56495 x 10° 2.33656 x 10° Std 1.03724 x 10? 0.00000 x 10° 3.57940 x 10! 
F66 = Ave 1400 1.40029 x 103 1400 F81— Ave 3.12805 x 10? 3.12754 x 10° 3.12732 x 10° 
Std 0 6.71546 x 107! 0 Std 3.07041 x 10° 8.63059 x 1071 1.02056 x 10° 
F67.—s Ave 1.5000 x 10? 1.50035 x 103 1.50020 x 103 F82.—s Ave 3.39538 x 10° 3.42503 x 10? 3.41551 x 10° 
Std 8.76352 x 10-4 ~—- 2.06751 x 107! 1.74925 x 107! Std 2.76054 x 107! 3.31098 x 10! 3.24314 x 10! 
F68 = Ave 1.60002 x 10? 1.60066 x 103 1.60058 x 103 
Std 1.86852 x 10-2 2.96332 x 107! 4.73527 x 107! 
Bold values indicates the best outcomes. 
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Fig. 18. Comparison among LSHADE-SPACMA, LSHADE-cnEpSin, and NOA using CEC2017. 
gy (X)=1= 140.45x1 <0 and Std obtained by NOA and 10 rival algorithms, are found in 
x5X3 Table 14. This table demonstrates that NOA is the most effective 
X1 + X2 method due to its higher Best, Ave, Std, and Rank. Here, the 
84 (X) = 15 1<0 proposed algorithm’s convergence rate is shown on this problem 


Variable range 0.05 < x; < 2.00 
0.25 < x» < 1.30 
2.00 < x3 < 15.0 


The near-optimal value and weight of three design variables, 
along with some other statistical data such as Ave, Rank, p-value, 
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in Fig. 20(b) which shows that NOA has a high rate of convergence 
in the right direction of the near-optimal solution. 


6.3. Pressure vessel design problem 


In this problem, the goal is to reduce total production by 
finding the best possible values for four design variables, while 
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Fig. 19. The welded beam design: (a) Structure [105] and (b) Convergence curve. 
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Fig. 20. Tension/compression spring design: (a) Schematic, and (b) Convergence curve. 
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Fig. 21. Pressure Vessel: (a) Structure and (b) Convergence curve. 
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Table 13 
Results of Welded beam design problem. 
Algorithms xy X2 x3 x3 Best Ave Std Rank p-value 
NOA 0.20572 3.47070 9.03662 0.20573 1.72487 1.724866 4.8974 x 10-8 1 3.020 x 107" 
SCA 0.19609 3.76215 9.07493 0.21069 1.79372 1.852441 3.7095 x 107? 10 3.020 x 1071! 
SSA 0.20438 3.49987 9.03663 0.20573 1.72671 1.782344 5.1727 x 107? 9 3.338 x 10-3 
GBO 0.20572 3.47070 9.03662 0.20573 1.72487 1.724866 1.6928 x 10-6 2 3.020 x 1071! 
RUN 0.20572 3.47069 9.03660 0.20573 1.72487 1.754908 4.3029 x 10-2 8 3.020 x 1071! 
WOA 0.17104 4.22706 9.43259 0.20383 1.82262 2.307445 5.4806 x 107! 12 8.891 x 1071? 
GTO 0.20572 3.47070 9.03662 0.20573 1.72487 1.750119 9.5687 x 107? 7 3.020 x 1071! 
AVOA 0.20570 3.47110 9.03660 0.20573 1.72490 1.742485 3.1015 x 10-7 6 3.020 x 1071! 
EO 0.20572 3.47070 9.03662 0.20573 1.72487 1.725409 1.3164 x 1073 3 3.020 x 1071! 
GWO 0.20553 3.47534 9.03664 0.20574 1.72530 1.726201 8.5639 x 10-4 5 3.020 x 107-1"! 
RFO 0.20572 3.47068 9.03692 0.20573 1.72490 2.076155 2.7209 x 107! 11 3.020 x 1071! 
SMA 0.20572 3.47070 9.03662 0.20573 1.72487 1.725904 1.6644 x 1073 4 3.020 x 1071! 
Table 14 
Results of the Tension/compression spring design problem. 
Algorithms pal X2 X3 Best Ave Std Rank p-value 
NOA 0.05169 0.35671 11.28932 0.0126652 0.01267 1.5745 x 10-7 1 3.020 x 10-1"! 
SCA 0.05000 0.31738 14.06135 0.0127438 0.01295 1.2210 x 10-4 3 3.020 x 1071! 
SSA 0.05188 0.36143 11.01809 0.0126659 0.01301 6.9395 x 10-4 4 3.020 x 1071! 
GBO 0.05187 0.36105 11.03921 0.0126658 0.01268 1.3720 x 107° 2 3.020 x 1071! 
RUN 0.05034 0.32523 13.40527 0.0126991 0.01526 1.9227 x 107-3 7 3.020 x 1071! 
WOA 0.05332 0.39732 9.25282 0.0127127 0.01458 1.3984 x 10-3 6 5.427 x 107"! 
GTO 0.05182 0.35990 11.10471 0.0126655 16.67775 3.7901 x 10! 9 3.020 x 1071! 
AVOA 0.05217 0.36831 10.64036 0.0126694 0.01330 8.0423 x 10-4 5 2.114 x 1071! 
EO 0.05200 0.36428 10.85909 0.0126670 50.00788 5.0849 x 10! 12 3.001 x 1071! 
GWO 0.05183 0.36016 11.09745 0.0126742 13.34469 3.4571 x 10! 8 2.800 x 1071! 
RFO 0.05286 0.38547 9.78294 0.0126898 30.00981 4.6604 x 10! 10 2.800 x 1071! 
SMA 0.05169 0.35671 11.28932 0.0126652 30.00997 4.6604 x 10! 11 3.020 x 1071! 
Table 15 
Results for pressure vessel design problem. 
Algorithms x1 X2 x3 X3 Best Ave Std Rank p-value 
NOA 0.77818 0.38466 40.31962 200.00000 5885.43417 5885.4342 1.0757 x 10-7 1 3.0199 x 10-71 
SCA 0.83218 0.44206 41.84167 181.80835 6289.77823 6833.4042 4.6598 x 10? 9 3.0199 x 1071! 
SSA 0.81117 0.40097 42.02888 177.51179 594452042 6471.3539 4.5254 x 10? 5 3.0199 x 1071! 
GBO 0.77818 0.38466 40.31962 200.00000 5885.43418 5976.3079 1.3660 x 10? 3 3.0199 x 1071! 
RUN 0.77818 0.38466 40.31971 199,99884 5885.45929 6992.9746 5.6795 x 10? 10 3.0199 x 10-1! 
WOA 0.78146 0.50567 40.32326 199,94933 6258.58401 7982.7928 1.4796 x 10° 11 5.5605 x 10-10 
GTO 0.77818 0.38466 40.31962 200.00000 5885.43417 6575.6347 6.1669 x 10? 6 3.0199 x 10-1! 
AVOA 0.77834 0.38474 40.32804 199,88287 5885.71191 6661.2247 6.0691 x 10? 7 3.0123 x 10-1! 
EO 0.77972 0.38542 40.39936 198.89289 5888.07006 6712.2988 5.2585 x 10? 8 3.0199 x 10-1! 
Gwo 0.77840 0.38496 40.32522 199,94274 5887.61463 5942.6436 2.2099 x 10? 2 3.0199 x 10-1! 
RFO 0.79256 0.39185 41.06460 189.91741 5911.50327 57488.2073 6.1630 x 104 12 3.0199 x 1071! 
SMA 0.77818 0.38466 40.31962 200.00000 5885.43417 6447.8593 5.3272 x 10? 4 3.0199 x 1071! 
Table 16 
Results for the three-bar truss design problem. 
Algorithms Xy X2 Best Ave Std Rank 
NOA 0.78868 0.40825 263.89584338 263.89584 3.1667 x 10-4 1 
SCA 0.79059 0.40291 263.90317968 265.23281 4.7872 x 10° 12 
SSA 0.78869 0.40820 263.89584364 263.89622 5.3089 x 10-4 6 
GBO 0.78868 0.40825 263.89584338 263.89584 9.4191 x 10-8 2 
RUN 0.78877 0.40798 263.89585 142 263.91749 3.1806 x 10-7 10 
WOA 0.78858 0.40852 263.89585061 264.74883 1.4018 x 10° 11 
GTO 0.78868 0.40825 263.89584338 263.89584 1.8279 x 10-° 3 
AVOA 0.78882 0.40784 263.89585871 263.90183 6.9221 x 1073 9 
EO 0.78871 0.40816 263.89584408 263.89594 1.1355 x 1074 4 
GWO 0.78879 0.40792 263.89592072 263.89766 1.8777 x 10-3 8 
RFO 0.78860 0.40846 263.89584947 263.89610 3.0510 x 10-4 5 
SMA 0.78868 0.40825 263.89584338 263.89662 1.6458 x 1073 Wi 
keeping pressure requirements in mind as an optimization con- are all design variables. In Fig. 21 (a), you can see the pressure 


straint. The inner radius (R), the thickness of the head (Th), the vessel’s structure. The mathematical model of this problem is as 
thickness of the shell (Ts), and the cylindrical portion length (L) follows [24]: 
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Table 17 
Results for 10-bar truss design problem. 
Algorithms NOA SCA SSA GBO RUN WOA GTO AVOA EO Gwo RFO SMA 
x 30.5214 28.6123 30.9661 30.6167 30.7498 30.5638 30.5017 31.5595 30.7545 30.4202 349 x 10-9 2.44 x 10°° 
x2 0.1000 1.914351 0.10000 0.10000 0.10000 0.13135 0.10000 0.10000 0.10001 0.10075 0.10075 0.10000 
x3 23.1688 23.657021 23.9930 22.9636 23.2853 22.0098 23.3533 23.1417 23.1536 23,3338 23,3338 23.1846 
Xa 15.2421 14.415974 14.8518 15.6008 14.0370 13.5376 14.9793 14.8764 15.2100 15.3604 15.3604 15.0983 
x5 0.1000 0.141659 0.1000 0.1000 0.1013 0.1313 0.1001 0.1000 0.1000 0.1026 0.1026 0.1000 
X6 0.5534 0.436889 0.5075 0.5617 0.3971 0.1310 0.4709 0.4958 0.5403 0.4250 0.4250 0.5390 
xy 21.0460 23.206193 20.9116 20.8822 21.5571 22.0132 21.0565 20.8951 20.9686 21.0624 21.0624 21.1584 
Xg 7.4607 8.391798 7.4046 7.4580 7.5265 9.5364 7.4477 7.4879 7.4618 7.4445 7.4445 7.4829 
X9 0.1000 0.186644 0.1000 0.1000 0.1000 0.1313 0.1000 0.1000 0.1000 0.1001 0.1001 0.1000 
X10 21.5224 21.250641 21.1613 21.5169 21.7863 22.0792 21.6664 21.2666 21.4787 21.5265 21.5265 21.3691 
Best 5060.8594 5190.53325 5062.7407 5061.3352 5067.0943 5131.1998 5061.5516 5062.6786 5060.9583 5063.1240 5063.1240 5061.0336 
Ave 5061.9494 5473.525475  5072.5080 5072.3065 5077.0518 6435.9602 5 132.1667 5073.4743 5067.2202 5080.9003 5069.4373 5065.3404 
Std 4.00 x 10° 576.7138176 8.9489 9.2100 3.1148 816.7081 207.0000 7.7513 7.7630 10.4567 6.4320 6.6346 
Rank 1 1 6 5 8 12 10 7 3 9 4 2 
p-value 3.019 x 2.4386 x 3.822 x 5.491 x 3.019 x 1.464 x 5.572 x 1.411 x 1.776 x 3.471 x 2.436 x 3.019 x 
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Fig. 22. Three-bar truss problem: (a) Shape and (b) Convergence curve. 
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Fig. 23. Convergence curve of 10-bar truss design problem. 


- Solutions of this problem are represented as follows: 
Consider X = [x1 x2 x3 X4] = [Ts Th R L] 

- The objective function employed along with the optimization 
algorithm to handle this problem is as: 


Minimize f (X) = 0.6224x1x3X4 + 1.7781x3x} + 3.1661x4x} 
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+ 19.84x3x4 


- Subject to the following constraints: 
Zi (X) = —x, + 0.0193x3 < 0 

22 (X) = —x3 + 0.00954x3 < 0 

§3 (X)= 
&4 (X) = Xq — 240 < 0 


4 
TEX4X3 38 


1296000 < 0 


Variable range 0 < x; < 99 
0<x, <99 
10 < x3 < 200 
10 < x4 < 200 
As shown in Table 15, NOA outperforms all other optimizers 
in terms of Ave, Worst, and Std values when solving the pressure 
vessel design problem. The averaged convergence curve obtained 


by the proposed algorithm when solving this problem is shown in 
Fig. 21(b) which affirms that NOA has a high convergence speed. 


6.4. The three-bar truss design problem 


Specifically, the goal of this problem is to determine the opti- 
mal value of three variables, which include the areas of bars 1, 
2, and 3, to minimize the weight of the three-bar truss while 
also meeting certain constraints. Fig. 22 (a) depicts the general 
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Table 18 
Description of some standard test functions. 
ID Functions D Domain Global opt 
D 
Fl Fi=) x 100 [—100,100 0 
i=1 
D D 
F2 F2= |x +] [ail 100 [—100,100 0 
i=1 i=1 
2 
D D 
F3 F3=)) xj 100 [—100,100 0) 
i=1 \ j=1 
F4 F4 = max (|x;|)|1<i<D 100 [—100,100 0 
D-1 
F5 F5=) > [100 (x1 — 22)" + Gi — »?| 100 [—30,30] 0 
i=1 
D-1 
F6 F6= > [x + 0.5) 100 [—100,100] 0 
i=1 
D 
F7 F7= > ix? + random{(0, 1] 100 [—1.28,1.28] 0 
i=1 
D-1 
F8 F8 = —xjsin ( il) 100 [—500,500] —418.98 x D 
i=1 
D 
F9 F9= > [x? — 10cos (277x;) + 10] 100 [—5.12,5.12] 0 
i=1 
1 D 1 D 
F10 F10 = —20exp | -0.2 | Ls exp E os ana) +20+e 100 [—32,32] 0 
1 Z 2 Xj 
F1l Fll= x? cos( —)+1 100 —600,600 0 
4000 be ' I] (3) [ ] 
i=1 i=1 
x D-1 
F12 FI2= 5 (sos (ay) +) 4 — 1) [1+ 10sin? (y;,1)] +  — v7) 100 [—50,50] 0 
i=1 
i L 
+}  u(xj, 10, 100, 4) 
i=1 
X D-1 
F13 FI3= 5 (sos (3x1) +) @% — 1)? [1+ sin? (374))] 100 [—50,50] 0 
i=1 
d 
+ (%q — 1)? [1+ sin? (2mxp)]) + > u(x;, 5, 100, 4) 
i=1 
-1 
F14 Fl4= 5 2 [-65,65] 1 
aon jadt pane (xi — aj) 
11 X12 
1( by +bjx: 
F15 FI5=)|a,— 5 es) 4 [-5,5] 0.00030 
az bj + bjx3 + Xa 
1 
F16 F16 = 4x} — 2.1x4 4 3M + X1X2 — 4x3 + 4x5 2 [-5,5] —1.0316 
515, 5 1 
F17 F17 =| x2 xj + —x1-6 + 10{1 cos (x1) + 10 2 [-5,5] 0.398 
An? iT 8x 
F18 F18 = [1+ (x1 +x2 + 1)? (19 — 14x; + 3x7 — 14x2 + 6x1x2 + 3x3) 2 [—2,2] 3 
x [30 + (2x1 — 3x2)? 
x (18 — 32x, + 12x? + 48x2 — 36x1x2 + 27x3) | 
4 
2 
F19 F19 = — Scie SH) 3 1,3] —3.86 
i=1 
“ 6 2 
F20 F20 = — » je set ti Pa) 6 [0,1] —3.32 


i=1 


shape of the problem [106,107]. This problem is mathematically 


formulated as follows: 


(continued on next page) 


- Solutions to this problem are represented as follows: 


X= [x1 x | 
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Table 18 (continued). 


ID Functions D Domain Global opt 
5 

F21 F21= wis a;) (X — aj)" a] 4 [0,10] —10.1532 
i=1 
7 

F22 F22 = ws a;) (X — aj)" a] 4 [0,10] —10.4028 
i=1 
10 

F23 F23 = —) > [(K — a) XK - a)" a] 4 [0,10] —10.5363 


t=1 


-100 -100 


Fig. 24. Two-dimensional view of 23 well-known test functions. 
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Fig. 24. (continued). 


- The objective function employed along with the optimization —g, (x) — z P—o <0 
algorithm to handle this problem is as: 2X2 + X1 > 
Minimize f (X) = (2V2x + x2) xl Variable range 0 < x;,xX2 <1 


KN KN 

[= 100 cm, P =2—,,0 =2_, 
- Subject to the following constraints: en acs 

This problem is solved using NOA, and the results are com- 


VJ2x, +X) pared to those obtained using the rival optimizers as shown in 

£1 (X) = P—o <0 Table 16. From this table, NOA appears to be competitive with 
V 2x5 + 2x1%2 GBO and GTO in terms of the best, and Ave and superior to 

X2 the others for the best, Ave, and Std of fitness values obtained 


&2 (X) = 


P : : , 
J 2x? + 2x 4X9 from 30 independent runs. Table 16 also contains the optimal 
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Table 19 
Characteristics of CEC-2014 test functions. 
Type ID Functions Global opt. Domain 
Unimodal F24 (CF1 Function of Rotated High Conditioned Elliptic 100 —100, 100 
function F25 (CF2 Function of Rotated Bent Cigar 300 —100, 100 
F26 (CF3 Function of Rotated Discus 
F27 (CF4 Function of Shifted and Rotated Rosenbrock 400 —100, 100 
F28 (CF5 Function of Shifted and Rotated Ackley 500 —100, 100 
F29 (CF6 Function of Shifted and Rotated Weierstrass 600 —100, 100 
F30 (CF7 Function of Shifted and Rotated Griewank 700 —100, 100 
F31 (CF8 Function of Shifted Rastrigin 800 —100, 100 
Simple multimodal F32 (CF9 Function of Shifted and Rotated Rastrigin 900 —100, 100 
Test functions F33 (CF10 Function of Shifted Schwefel 1000 —100, 100 
F34 (CF11 Function of Shifted and Rotated Schwefel 1100 —100, 100 
F35 (CF12 Function of Shifted and Rotated Katsuura 1200 —100, 100 
F36 (CF13 Function of Shifted and Rotated HappyCat 1300 —100, 100 
F37 (CF14 Function of Shifted and Rotated HGBat 1400 —100, 100 
F38 (CF15 Function of Shifted and Rotated Expanded Griewank’s plus Rosenbrock 1500 —100, 100 
F39 (CF16 Function of Shifted and Rotated Expanded Scaffer 1600 —100, 100 
F40 (CF17 Function 1 Hybrid 1700 —100, 100 
Hybrid test F41 (CF18 Function 2 Hybrid 1800 —100, 100 
functions F42 (CF19 Function 3 Hybrid 1900 —100, 100 
F43 (CF20 Function 4 Hybrid 2000 —100, 100 
F44 (CF21 Function 5 Hybrid 2100 —100, 100 
F45 (CF22 Function 6 Hybrid 2200 —100, 100 
F46 (CF23 Function 1 Composition 2300 —100, 100 
F47 (CF24 Function 2 Composition 2400 —100, 100 
Composition test F48 (CF25 Function 3 Composition 2500 —100, 100 
functions F49 (CF26 Function 4 Composition 2600 —100, 100 
F50 (CF27 Function 5 Composition 2700 —100, 100 
F51 (CF28 Function 6 Composition 2800 —100, 100 
F52 (CF29 Function 7 Composition 2900 —100, 100 
F53 (CF30 Function 8 Composition 3000 —100, 100 
Table 20 
Characteristics of CEC-2017 test functions. 
Type ID Functions Global opt. Domain 
Unimodal F54 (CF1) Function of Shifted and Rotated Bent Cigar 100 —100, 100 
function F55 (CF3) Function of Shifted and Rotated Zakharov 300 —100, 100 
F56 (CF4) Function of Shifted and Rotated Rosenbrock 400 —100, 100 
F57 (CF5) Function of Shifted and Rotated Rastrigin 500 —100, 100 
Simple multimodal F58 (CF6) Function of Shifted and Rotated Expanded Scaffer 600 —100, 100 
Test functions F59 (CF7) Function of Shifted and Rotated Lunacek Bi_Rastrigin 700 —100, 100 
F6O (CF8) Function of Shifted and Rotated Non-Continuous Rastrigin 800 —100, 100 
F61 (CF9) Function of Shifted and Rotated Levy 900 —100, 100 
F62 (CF10) Function of Shifted and Rotated Schwefel 1000 —100, 100 
F63 (CF11) Function 1 Hybrid 1100 —100, 100 
F64 (CF12) Function 2 Hybrid 1200 —100, 100 
F65 (CF13) Function 3 Hybrid 1300 —100, 100 
Hybtid test F66 (CF14) Function 4 Hybrid 1400 —100, 100 
functions F67 (CF15) Function 5 Hybrid 1500 —100, 100 
F68 (CF16) Function 6 Hybrid 1600 —100, 100 
F69 (CF17) Function 7 Hybrid 1700 —100, 100 
F70 (CF18) Function 8 Hybrid 1800 —100, 100 
F71 (CF19) Function 9 Hybrid 1900 —100, 100 
F72 (CF20) Function 10 Hybrid 2000 —100, 100 
F73 (CF21) Function 1 Composition 2100 —100, 100 
F74 (CF22) Function 2 Composition 2200 —100, 100 
F75 (CF23) Function 3 Composition 2300 —100, 100 
Composition test F76 (CF24) Function 4 Composition 2400 —100, 100 
functions F77 (CF25) Function 5 Composition 2500 —100, 100 
F78 (CF26) Function 6 Composition 2600 —100, 100 
F79 (CF27) Function 7 Composition 2700 —100, 100 
F80 (CF28) Function 8 Composition 2800 —100, 100 
F81 (CF29) Function 9 Composition 2900 —100, 100 
F82 (CF30) Function 10 Composition 3000 —100, 100 


values of the design variables, as well as the corresponding fitness 6.5. The 10-bar truss design problem 
values obtained by each algorithm. Fig. 22(b) depicts the averaged 


convergence curve obtained by the proposed algorithm when The 10-bar truss design problem is the final engineering de- 
solving this problem, which demonstrates that NOA has a fast _ sign problem that has been investigated in this study. This prob- 
convergence speed. lem consists of ten design variables that must be precisely 
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Table 21 
Characteristics of CEC-2020 test functions. 
Type ID Functions Global opt. Domain 
Unimodal F83 (CF1 Function of Shifted and Rotated Bent Cigar 100 —100, 100 
Multimodal F84 (CF2 Function of Shifted and Rotated Lunacek Bi_Rastrigin 700 —100, 100 
F85 (CF3 Function 1 Hybrid 1100 —100, 100 
Hybrid test F86 (CF4 Function 2 Hybrid 1700 —100, 100 
functions F87 (CF5 Function 3 Hybrid 1900 —100, 100 
F88 (CF6 Function 4 Hybrid 2100 —100, 100 
F89 (CF7 Function 5 Hybrid 1600 —100, 100 
Hybrid test F9O (CF8 Function 1 Composition 2200 —100, 100 
functions F91 (CF9 Function 2 Composition 2400 —100, 100 
F92 (CF10) Function 3 Composition 2500 —100, 100 


optimized to achieve the best possible design. This optimum 
design must be subjected to ten stress constraints and twelve dis- 
placement constraints to be considered complete. The mathemat- 
ical model for this problem, as well as other relevant information, 
are available in [104]. 

This problem was studied using the NOA and rival algorithms, 
and the results are presented in Table 17. These results include 
the optimized design variables, as well as the best, Ave, Rank, and 
Std of the fitness values obtained by each algorithm throughout 
30 separate runs. Examining this table reveals that NOA produces 
significantly better results than all of the other competing algo- 
rithms. The proposed algorithm’s performance in terms of the 
maximum number of function evaluations required to reach the 
desired average fitness value must be evaluated, even though 
NOA may outperform the others in terms of the various statis- 
tical information under consideration. Because of this, Fig. 23 
is presented to show the average fitness values obtained by 
the proposed algorithm during the optimization process, which 
proves that NOA has a rapid convergence rate. 


7. Conclusion 


This work proposes a novel MH algorithm known as the NOA 
as an alternative for solving optimization problems. The search, 
cache, and recovery behaviors of the nutcracker are the main 
inspiration of NOA. The performance of this algorithm was tested 
in a series of experiments. Twenty-three standard functions, test 
suites of CEC2014, CEC-2017, and CEC-2020, and five real-world 
engineering design problems were employed in this work to 
assess the proposed algorithm’s exploratory capabilities and its 
exploitation, avoidance of local optima, and convergence. NOA 
was qualitatively evaluated using a variety of metrics, including 
search history, trajectory, the average fitness of solutions, and 
the best solution in each iteration. Scientifically, the Wilcoxon 
rank-sum test was used to assess the effectiveness of the pro- 
posed algorithm. The experimental results show that NOA can 
guarantee excellent exploration performance while maintaining 
an outstanding balance between exploration and exploitability, 
resulting in the superior performance of the proposed NOA. Five 
engineering problems (i.e., a welded beam, a tension/compression 
spring, a pressure vessel, a 3 bar truss, and a 10 bar truss) 
were solved in this study by obtaining additional evaluation. NOA 
outperformed all rival optimizers, including CEC2017 winners 
(LSHADE-SPACMA and LSHADE-cnEpSin), CEC2014 winners (L- 
SHADE and an adaptive variant of L-SHADE (AL-SHADE)), some of 
the highly-cited MH algorithms (WOA, SSA, and GWO), and some 
of the recently-published algorithms (SMA, GBO, EO, RUN, AVOA, 
RFO and GTO), in terms of the quality of outcomes and conver- 
gence speed. The NOA algorithm is currently being developed in 
binary and multi-objective variants under the names binary and 
multi-objective NOAs, respectively. 
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